登录
注册
开源
企业版
高校版
搜索
帮助中心
使用条款
关于我们
开源
企业版
高校版
私有云
模力方舟
AI 队友
登录
注册
代码拉取完成,页面将自动刷新
捐赠
捐赠前请先登录
取消
前往登录
扫描微信二维码支付
取消
支付完成
支付提示
将跳转至支付宝完成支付
确定
取消
Watch
不关注
关注所有动态
仅关注版本发行动态
关注但不提醒动态
4
Star
0
Fork
30
src-openEuler
/
spark
代码
Issues
19
Pull Requests
3
Wiki
统计
流水线
服务
JavaDoc
PHPDoc
质量分析
Jenkins for Gitee
腾讯云托管
腾讯云 Serverless
悬镜安全
阿里云 SAE
Codeblitz
SBOM
我知道了,不再自动展开
更新失败,请稍后重试!
移除标识
内容风险标识
本任务被
标识为内容中包含有代码安全 Bug 、隐私泄露等敏感信息,仓库外成员不可访问
【开源之夏】基于openEuler构建大数据体验平台-Update Spark Version to 3.3.0
待办的
#I5F42R
开源之夏2023
Xumhan
创建于
2022-07-01 17:06
**项目标题:基于openEuler构建大数据体验平台-Update Spark Version to 3.3.0** 【项目难度】:进阶 【项目描述】:基于openEuler构建一站式大数据体验平台,可以对接Spark、Flink等大数据平台。Apache Spark是一种多语言引擎,用于在单节点机器或集群上执行数据工程、数据科学和机器学习。通过构建大数据体验平台发现并完善openEuler在大数据场景的不足,打造基于openEuler的大数据开源解决方案的雏形。此Issues为部分内容。详情见:https://summer-ospp.ac.cn/#/org/prodetail/22b970113 【产出标准】: 1、**引入基于openEuler22.03的Spark3.3.0的容器镜像。** 2、对不满足条件的操作系统软件包进行升级和添加,并上传至:https://gitee.com/src-openeuler。 【技术要求】: 1、掌握java/scala编程语言。对Dockerfile熟悉的同学优先。 2、熟练使用Linux。 3、对容器化有一定了解。使用(了解)过Spark、Flink、Kyuubi的同学优先。 【导师姓名/导师邮箱】:yikunkero/yikunkero@gmail.com 【成果提交仓库】: https://gitee.com/src-openeuler/spark https://gitee.com/src-openeuler 【相关参考资料】:https://spark.apache.org **project name:Building Bigdata Experience Platform Based on Openeuler-Update Spark Version to 3.3.0** 【Difficulty】:Advanced 【Description】:Build a one-stop big data experience platform based on openeuler, which can connect with spark, Flink and other big data platforms. Apache spark is a multilingual engine for performing data engineering, data science, and machine learning on single node machines or clusters. Discover and improve the deficiencies of openeuler in big data scenarios by building a big data experience platform, and create the prototype of big data open source solutions based on openeuler.This issues is part of the project.Full details: https://summer-ospp.ac.cn/#/org/prodetail/22b970113 【Output Requirements】: 1、Establish the docker image of spark3.3.0 based on openeuler22.03. 2、Upgrade and add the operating system software package that does not meet the conditions, and upload it to: https://gitee.com/src-openeuler. 【Technical Requirements】: 1. Master Java/Scala and be familiar with dockerfile. 2. Proficient in Linux. 3. Have a certain understanding of containerization. Students who have used (learned) spark, Flink and Kyuubi are preferred. 【Mentor/Email】:yikunkero/yikunkero@gmail.com 【Project Repository】: https://gitee.com/src-openeuler/spark https://gitee.com/src-openeuler 【Notes】:https://spark.apache.org
**项目标题:基于openEuler构建大数据体验平台-Update Spark Version to 3.3.0** 【项目难度】:进阶 【项目描述】:基于openEuler构建一站式大数据体验平台,可以对接Spark、Flink等大数据平台。Apache Spark是一种多语言引擎,用于在单节点机器或集群上执行数据工程、数据科学和机器学习。通过构建大数据体验平台发现并完善openEuler在大数据场景的不足,打造基于openEuler的大数据开源解决方案的雏形。此Issues为部分内容。详情见:https://summer-ospp.ac.cn/#/org/prodetail/22b970113 【产出标准】: 1、**引入基于openEuler22.03的Spark3.3.0的容器镜像。** 2、对不满足条件的操作系统软件包进行升级和添加,并上传至:https://gitee.com/src-openeuler。 【技术要求】: 1、掌握java/scala编程语言。对Dockerfile熟悉的同学优先。 2、熟练使用Linux。 3、对容器化有一定了解。使用(了解)过Spark、Flink、Kyuubi的同学优先。 【导师姓名/导师邮箱】:yikunkero/yikunkero@gmail.com 【成果提交仓库】: https://gitee.com/src-openeuler/spark https://gitee.com/src-openeuler 【相关参考资料】:https://spark.apache.org **project name:Building Bigdata Experience Platform Based on Openeuler-Update Spark Version to 3.3.0** 【Difficulty】:Advanced 【Description】:Build a one-stop big data experience platform based on openeuler, which can connect with spark, Flink and other big data platforms. Apache spark is a multilingual engine for performing data engineering, data science, and machine learning on single node machines or clusters. Discover and improve the deficiencies of openeuler in big data scenarios by building a big data experience platform, and create the prototype of big data open source solutions based on openeuler.This issues is part of the project.Full details: https://summer-ospp.ac.cn/#/org/prodetail/22b970113 【Output Requirements】: 1、Establish the docker image of spark3.3.0 based on openeuler22.03. 2、Upgrade and add the operating system software package that does not meet the conditions, and upload it to: https://gitee.com/src-openeuler. 【Technical Requirements】: 1. Master Java/Scala and be familiar with dockerfile. 2. Proficient in Linux. 3. Have a certain understanding of containerization. Students who have used (learned) spark, Flink and Kyuubi are preferred. 【Mentor/Email】:yikunkero/yikunkero@gmail.com 【Project Repository】: https://gitee.com/src-openeuler/spark https://gitee.com/src-openeuler 【Notes】:https://spark.apache.org
评论 (
1
)
登录
后才可以发表评论
状态
待办的
待办的
进行中
已完成
已拒绝
负责人
未设置
标签
未设置
项目
未立项任务
未立项任务
里程碑
未关联里程碑
未关联里程碑
Pull Requests
未关联
未关联
关联的 Pull Requests 被合并后可能会关闭此 issue
分支
未关联
分支 (25)
标签 (26)
master
openEuler-24.03-LTS-SP2
openEuler-24.03-LTS-Next
openEuler-24.03-LTS-SP3
openEuler-22.03-LTS-SP1
openEuler-24.03-LTS-SP1
openEuler-22.03-LTS-SP4
openEuler-24.03-LTS
openEuler-22.03-LTS-SP3
openEuler-20.03-LTS-SP4
openEuler-25.03
openEuler-25.09
openEuler-24.09
openEuler-22.03-LTS-Next
openEuler-20.03-LTS-SP1
openEuler-22.03-LTS
openEuler-22.03-LTS-SP2
openEuler-22.09
openEuler-23.03
openEuler-23.09
openEuler-21.09
openEuler-20.03-LTS-SP2
openEuler-20.03-LTS-SP3
openEuler-20.03-LTS-Next
openEuler-20.09
openEuler-25.09-release
openEuler-24.03-LTS-SP2-release
openEuler-25.03-release
openEuler-24.03-LTS-update-20250110
openEuler-24.03-LTS-SP1-update-20250110
openEuler-22.03-LTS-SP1-update-20250110
openEuler-22.03-LTS-SP3-update-20250110
openEuler-20.03-LTS-SP4-update-20250110
openEuler-22.03-LTS-SP4-update-20250110
openEuler-24.03-LTS-SP1-release
openEuler-22.03-LTS-SP4-release
openEuler-24.09-release
openEuler-24.03-LTS-release
openEuler-22.03-LTS-SP3-release
openEuler-23.09-rc5
openEuler-22.03-LTS-SP1-release
openEuler-22.09-release
openEuler-22.09-rc5
openEuler-22.09-20220829
openEuler-22.03-LTS-20220331
openEuler-22.03-LTS-round5
openEuler-22.03-LTS-round3
openEuler-22.03-LTS-round2
openEuler-22.03-LTS-round1
openEuler-20.03-LTS-SP3-release
openEuler-20.03-LTS-SP2-20210624
开始日期   -   截止日期
-
置顶选项
不置顶
置顶等级:高
置顶等级:中
置顶等级:低
优先级
不指定
严重
主要
次要
不重要
预计工期
(小时)
参与者(1)
1
https://gitee.com/src-openeuler/spark.git
git@gitee.com:src-openeuler/spark.git
src-openeuler
spark
spark
点此查找更多帮助
搜索帮助
Git 命令在线学习
如何在 Gitee 导入 GitHub 仓库
Git 仓库基础操作
企业版和社区版功能对比
SSH 公钥设置
如何处理代码冲突
仓库体积过大,如何减小?
如何找回被删除的仓库数据
Gitee 产品配额说明
GitHub仓库快速导入Gitee及同步更新
什么是 Release(发行版)
将 PHP 项目自动发布到 packagist.org
仓库举报
回到顶部
登录提示
该操作需登录 Gitee 帐号,请先登录后再操作。
立即登录
没有帐号,去注册