From 57961b99ead7801e797f2d06fb217fad237992a1 Mon Sep 17 00:00:00 2001 From: zhengxian Date: Thu, 27 Feb 2020 22:42:19 +0800 Subject: [PATCH 1/3] add sig-artificial-intelligence-and-big-data --- .../OWNERS | 6 + .../README.md | 56 ++++++++++ ...ig-artificial-intelligence-and-big-data.md | 104 ++++++++++++++++++ ...artificial-intelligence-and-big-data_cn.md | 72 ++++++++++++ 4 files changed, 238 insertions(+) create mode 100644 sig/sig-artificial-intelligence-and-big-data/OWNERS create mode 100644 sig/sig-artificial-intelligence-and-big-data/README.md create mode 100644 sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md create mode 100644 sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md diff --git a/sig/sig-artificial-intelligence-and-big-data/OWNERS b/sig/sig-artificial-intelligence-and-big-data/OWNERS new file mode 100644 index 000000000..e6a26b14a --- /dev/null +++ b/sig/sig-artificial-intelligence-and-big-data/OWNERS @@ -0,0 +1,6 @@ +maintainers: + - sinever + - ZZZHB + - njlzk + - myeuler + - chxssg \ No newline at end of file diff --git a/sig/sig-artificial-intelligence-and-big-data/README.md b/sig/sig-artificial-intelligence-and-big-data/README.md new file mode 100644 index 000000000..4c438a3d6 --- /dev/null +++ b/sig/sig-artificial-intelligence-and-big-data/README.md @@ -0,0 +1,56 @@ +# sig-artificial-intelligence-and-big-data + + 大数据和人工智能已经深入到社会的很多领域，各行各业都可以用来提高生产力。工业界、学术界之外也有众多爱好者，为了更好的支持科研院所、生产企业中爱好者、开发者在openeuler上更快更好的进行大数据和人工智能的实践，open euler也需要具备大数据和人工智能的相关能力。 + - 将artificial intelligence和big data放在一起的原因 + - 一方面当大数据大规模用于生产时，人工智能还在实验阶段，另一方面，人工智能的普及也是从一个应用，一个部分逐步展开的， + 导致很多公司的大数据和人工智能从上到下都是两套甚至多套，形成割裂局面，而实际上，大数据的处理结果还可以用于模型训练，而模型的训练需要的样本也需要大数据技术进行预处理。 + 逐步意识到这个问题后，很多大数据工具有了模型训练和推理功能，如sparkml, flinkml，而众多人工智能框架也在逐渐增强数据处理能力，更是催生了submarine、tony这种大数据和人工智能的融合工具。 + 因此open euler里直接将大数据和人工智能放在一起考虑。 + - 该SIG的业务范围 + - openeuler中大数据和人工智能的基础运行能力，包括对各种芯片的支持和加速库，各种数据仓库，分析引擎，训练引擎，算法库，数据集等。 + - openeuler中大数据和人工智能的统一平台，将各种常用的工具软件集成提供统一的用户界面解决各种维护环境的痛苦，让大数据和人工智能在openeuler上更易上手，更好用。 + - openeuler中大数据和人工智能的性能优化，对通用软件在openeuler上的性能优化 + - openeuler中大数据和人工智能的能力集成，新芯片和软件进入openeuler时的支持 + +# 会议 + +- 每周五上午11：00 - 11：30 +- 线上 +- ZOOM地址：https://zoom.com.cn/j/558675882 + +# 成员 + +### Maintainer列表 + - sinever + - ZZZHB + - njlzk + - myeuler + - chxssg + +### Committer列表 + +- sinever + + +# 联系方式 + +*<如果需要单独申请邮件列表，请在此补充邮箱名称：sig-yousigname@openeuler.org>* + +- [邮件列表](sig-yoursigname@openeuler.org) +- [IRC公开会议]() +- [slack](openeuler.slack.com) + + + + + +# 项目清单 + +*<项目名称和申请表格一致，具体地址可以在申请下来以后在刷新>* + +项目名称： + +repository地址： + +- +- \ No newline at end of file diff --git a/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md b/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md new file mode 100644 index 000000000..3bc613fd8 --- /dev/null +++ b/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md @@ -0,0 +1,104 @@ + +# Application to create a new SIG +English | [简体中文](./sig-artificial-intelligence-and-big-data_cn.md) + + +Note: The Charter of this SIG follows the convention described in the openEuler charter [README] (/en/governance/README.md), and follows [SIG-governance] (/en/technical-committee/governance/SIG-governance.md). + +## SIG Mission and Scope + +- Why we create sig-artificial-intelligence-and-big-data in openEuler + - Big data and artificial intelligence have penetrated into many areas of our society, and used to improve productivity in many industries. + There are lots of enthusiasts outside the industrial and academic circles. + It is necessary to provide big data and artificial intelligence-related capabilities in open euler for scientists in research institutes and enthusiasts to implement big data and artificial intelligence on open euler, + +- Why we keep artificial intelligence and big data together + - On the one hand, when big data is used in production on a large scale, artificial intelligence is still in the experimental stage, on the other hand, the popularization of artificial intelligence is gradually being imported from one application to another, leading to a split situation of the big data and artificial intelligence in many companies. + In fact, the processing results of big data can then be used for model training, and the samples required for model training also require big data technology for preprocessing. + After gradually realizing this, many big data tools have model training and inference functions, such as sparkml for spark, flinkml for flink, and many artificial intelligence frameworks are gradually enhancing their data processing capabilities, which has also spawned a few fusion tools such as big data and tony. + Therefore, big data and artificial intelligence are directly considered together in open euler. + +- The scope of the SIG + - Basic capabilities of big data and artificial intelligence in open euler, including but not limited to supporting and accelerating libraries for various chips, various data warehouses, analysis engines, training engines, algorithm libraries, data sets, etc. + - A unified platform for big data and artificial intelligence in open euler, integrating various commonly used tools and software to provide a unified user interface to make big data and artificial intelligence easier and better to use on open euler. + - Performance optimization of big data and artificial intelligence in open euler. + - Integration of big data and artificial intelligence capabilities in open euler, supporting new chips and softwares in open euler + +- Which SIGs in openEuler to coorperate with + - Some tool may have some dependency packages, and in addition, they may have dependencies on kernel subsystems during new hardware support and performance optimization. + +### Deliverables +- Source and tar +  +### Repositories and description managed by this SIG + +- project name: + - data store, cache, query + - hdfs + - kafka + - hbase + - hive + - pular + - druid + - framework and library for data analysis + - spark + - flink + - mapreduce + - beam + - pandas + - numpy + - model training and predicting + - tensorflow + - caffe + - scikit-learn + - pytorch + - libsvm + - mkl + - neon + - dlib + - daal + - develop environment + - jupyter + - zeppelin + - resource management + - kubernetes + - mesos + - yarn + - to be continued + +### Cross-domain and external-oriented processes + +Cross-domain and externally-oriented processes and actions defined and implemented by this SIG: + +- Non-Internal Process Checklist + +- The organization guidance plan for the entire openEulerSIG owned by this SIG, etc. + + +## Basic Information + +### Project Introduction +    https: /gitee.com/openeuler/community/sig/sig-xxxx/ + +***Tips***: After the SIG is successfully created, https: /gitee.com/openeuler/community/sig/sig-xxxx/ management will be managed by the Maintainer, and the project team can enrich their project introduction, including but not limited to the following content. +``` +### Maintainers + - sinever + - ZZZHB + - njlzk + - myeuler + - chxssg + +### Committers + - sinever + +### Mailing list + +### IRC Channel + +### Conference Information + +### External Contact +-Name (Gitee ID) +``` + diff --git a/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md b/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md new file mode 100644 index 000000000..2e8ae341c --- /dev/null +++ b/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md @@ -0,0 +1,72 @@ + +# 新建SIG申请 +[English](./sig-template.md) | 简体中文 + + +说明：本SIG的Charter内容遵循openEuler章程 [README](/zh/governance/README.md)中描述的约定，使用[SIG-governance](/zh/technical-committee/governance/SIG-governance.md)中概述的角色和组织管理。 + +## SIG组工作目标和范围 + + - sig-artificial-intelligence-and-big-data的必要性 + - 大数据和人工智能已经深入到社会的很多领域，各行各业都可以用来提高生产力。工业界、 + 学术界之外也有众多爱好者，为了更好的支持科研院所、生产企业中爱好者、开发者在openeuler上更快更好的进行大数据和 + 人工智能的实践，open euler也需要具备大数据和人工智能的相关能力。 + - 将artificial intelligence和big data放在一起的原因 + - 一方面当大数据大规模用于生产时，人工智能还在实验阶段，另一方面，人工智能的普及也是从一个应用，一个部分逐步展开的， + 导致很多公司的大数据和人工智能从上到下都是两套甚至多套，形成割裂局面，而实际上，大数据的处理结果还可以用于模型训练，而模型的训练需要的样本也需要大数据技术进行预处理。 + 逐步意识到这个问题后，很多大数据工具有了模型训练和推理功能，如sparkml, flinkml，而众多人工智能框架也在逐渐增强数据处理能力，更是催生了submarine、tony这种大数据和人工智能的融合工具。 + 因此open euler里直接将大数据和人工智能放在一起考虑。 + - 该SIG的业务范围 + - openeuler中大数据和人工智能的基础运行能力，包括对各种芯片的支持和加速库，各种数据仓库，分析引擎，训练引擎，算法库，数据集等。 + - openeuler中大数据和人工智能的统一平台，将各种常用的工具软件集成提供统一的用户界面解决各种维护环境的痛苦，让大数据和人工智能在openeuler上更易上手，更好用。 + - openeuler中大数据和人工智能的性能优化，对通用软件在openeuler上的性能优化 + - openeuler中大数据和人工智能的能力集成，新芯片和软件进入openeuler时的支持 + + - 该SIG需要得到openEuler内哪些SIG的支持 + - 有些工具安装会有一些依赖包，另外在新硬件支持和性能优化过程中对内核各子系统也可能有依赖。 + + ### 该SIG管理的repository及描述 + +- 项目名称： + - 数据存储、缓存、查询 + - hdfs + - kafka + - hbase + - hive + - pular + - druid + - 数据分析框架与库 + - spark + - flink + - mapreduce + - beam + - pandas + - numpy + - 模型训练与推理 + - tensorflow + - caffe + - scikit-learn + - pytorch + - libsvm + - mkl + - neon + - dlib + - daal + - 开发环境 + - jupyter + - zeppelin + - 资源管理 + - kubernetes + - mesos + - yarn + - 待补充 + + + ### 跨领域和面向外部的流程 + + 由该SIG定义和执行的，且跨领域和面向外部的流程和行动： + + - 非内部流程清单 + - 该SIG拥有的面向整个openEulerSIG的组织指导计划等 + + -- Gitee From c3990dd7e52bd4cf6b20aba71c01a8364d6f9425 Mon Sep 17 00:00:00 2001 From: zhengxian Date: Mon, 2 Mar 2020 15:23:11 +0800 Subject: [PATCH 2/3] update sig-ai-bigdata --- sig/sig-ai-bigdata/OWNERS | 6 ++ sig/sig-ai-bigdata/README.md | 56 +++++++++++ sig/sig-ai-bigdata/sig-sig-ai-bigdata.md | 104 ++++++++++++++++++++ sig/sig-ai-bigdata/sig-sig-ai-bigdata_cn.md | 72 ++++++++++++++ 4 files changed, 238 insertions(+) create mode 100644 sig/sig-ai-bigdata/OWNERS create mode 100644 sig/sig-ai-bigdata/README.md create mode 100644 sig/sig-ai-bigdata/sig-sig-ai-bigdata.md create mode 100644 sig/sig-ai-bigdata/sig-sig-ai-bigdata_cn.md diff --git a/sig/sig-ai-bigdata/OWNERS b/sig/sig-ai-bigdata/OWNERS new file mode 100644 index 000000000..e6a26b14a --- /dev/null +++ b/sig/sig-ai-bigdata/OWNERS @@ -0,0 +1,6 @@ +maintainers: + - sinever + - ZZZHB + - njlzk + - myeuler + - chxssg \ No newline at end of file diff --git a/sig/sig-ai-bigdata/README.md b/sig/sig-ai-bigdata/README.md new file mode 100644 index 000000000..ffe92c78c --- /dev/null +++ b/sig/sig-ai-bigdata/README.md @@ -0,0 +1,56 @@ +# sig-ai-bigdata + + 大数据和人工智能已经深入到社会的很多领域，各行各业都可以用来提高生产力。工业界、学术界之外也有众多爱好者，为了更好的支持科研院所、生产企业中爱好者、开发者在openeuler上更快更好的进行大数据和人工智能的实践，open euler也需要具备大数据和人工智能的相关能力。 + - 将artificial intelligence和big data放在一起的原因 + - 一方面当大数据大规模用于生产时，人工智能还在实验阶段，另一方面，人工智能的普及也是从一个应用，一个部分逐步展开的， + 导致很多公司的大数据和人工智能从上到下都是两套甚至多套，形成割裂局面，而实际上，大数据的处理结果还可以用于模型训练，而模型的训练需要的样本也需要大数据技术进行预处理。 + 逐步意识到这个问题后，很多大数据工具有了模型训练和推理功能，如sparkml, flinkml，而众多人工智能框架也在逐渐增强数据处理能力，更是催生了submarine、tony这种大数据和人工智能的融合工具。 + 因此open euler里直接将大数据和人工智能放在一起考虑。 + - 该SIG的业务范围 + - openeuler中大数据和人工智能的基础运行能力，包括对各种芯片的支持和加速库，各种数据仓库，分析引擎，训练引擎，算法库，数据集等。 + - openeuler中大数据和人工智能的统一平台，将各种常用的工具软件集成提供统一的用户界面解决各种维护环境的痛苦，让大数据和人工智能在open euler上更易上手，更好用。 + - openeuler中大数据和人工智能的性能优化，对通用软件在openeuler上的性能优化 + - openeuler中大数据和人工智能的能力集成，新芯片和软件进入openeuler时的支持 + +# 会议 + +- 每周五上午11：00 - 11：30 +- 线上 +- ZOOM地址：https://zoom.com.cn/j/558675882 + +# 成员 + +### Maintainer列表 + - sinever + - ZZZHB + - njlzk + - myeuler + - chxssg + +### Committer列表 + +- sinever + + +# 联系方式 + +*<如果需要单独申请邮件列表，请在此补充邮箱名称：sig-yousigname@openeuler.org>* + +- [邮件列表](sig-yoursigname@openeuler.org) +- [IRC公开会议]() +- [slack](openeuler.slack.com) + + + + + +# 项目清单 + +*<项目名称和申请表格一致，具体地址可以在申请下来以后在刷新>* + +项目名称： + +repository地址： + +- +- \ No newline at end of file diff --git a/sig/sig-ai-bigdata/sig-sig-ai-bigdata.md b/sig/sig-ai-bigdata/sig-sig-ai-bigdata.md new file mode 100644 index 000000000..240c14e53 --- /dev/null +++ b/sig/sig-ai-bigdata/sig-sig-ai-bigdata.md @@ -0,0 +1,104 @@ + +# Application to create a new SIG +English | [简体中文](./sig-ai-bigdata_cn.md) + + +Note: The Charter of this SIG follows the convention described in the openEuler charter [README] (/en/governance/README.md), and follows [SIG-governance] (/en/technical-committee/governance/SIG-governance.md). + +## SIG Mission and Scope + +- Why we create sig-ai-bigdata in openEuler + - Big data and artificial intelligence have penetrated into many areas of our society, and used to improve productivity in many industries. + There are lots of enthusiasts outside the industrial and academic circles. + It is necessary to provide big data and artificial intelligence-related capabilities in open euler for scientists in research institutes and enthusiasts to implement big data and artificial intelligence on open euler, + +- Why we keep artificial intelligence and big data together + - On the one hand, when big data is used in production on a large scale, artificial intelligence is still in the experimental stage, on the other hand, the popularization of artificial intelligence is gradually being imported from one application to another, leading to a split situation of the big data and artificial intelligence in many companies. + In fact, the processing results of big data can then be used for model training, and the samples required for model training also require big data technology for preprocessing. + After gradually realizing this, many big data tools have model training and inference functions, such as sparkml for spark, flinkml for flink, and many artificial intelligence frameworks are gradually enhancing their data processing capabilities, which has also spawned a few fusion tools such as big data and tony. + Therefore, big data and artificial intelligence are directly considered together in open euler. + +- The scope of the SIG + - Basic capabilities of big data and artificial intelligence in open euler, including but not limited to supporting and accelerating libraries for various chips, various data warehouses, analysis engines, training engines, algorithm libraries, data sets, etc. + - A unified platform for big data and artificial intelligence in open euler, integrating various commonly used tools and software to provide a unified user interface to make big data and artificial intelligence easier and better to use on open euler. + - Performance optimization of big data and artificial intelligence in open euler. + - Integration of big data and artificial intelligence capabilities in open euler, supporting new chips and softwares in open euler + +- Which SIGs in openEuler to coorperate with + - Some tool may have some dependency packages, and in addition, they may have dependencies on kernel subsystems during new hardware support and performance optimization. + +### Deliverables +- Source and tar +  +### Repositories and description managed by this SIG + +- project name: + - data store, cache, query + - hdfs + - kafka + - hbase + - hive + - pular + - druid + - framework and library for data analysis + - spark + - flink + - mapreduce + - beam + - pandas + - numpy + - model training and predicting + - tensorflow + - caffe + - scikit-learn + - pytorch + - libsvm + - mkl + - neon + - dlib + - daal + - develop environment + - jupyter + - zeppelin + - resource management + - kubernetes + - mesos + - yarn + - to be continued + +### Cross-domain and external-oriented processes + +Cross-domain and externally-oriented processes and actions defined and implemented by this SIG: + +- Non-Internal Process Checklist + +- The organization guidance plan for the entire openEulerSIG owned by this SIG, etc. + + +## Basic Information + +### Project Introduction +    https: /gitee.com/openeuler/community/sig/sig-xxxx/ + +***Tips***: After the SIG is successfully created, https: /gitee.com/openeuler/community/sig/sig-xxxx/ management will be managed by the Maintainer, and the project team can enrich their project introduction, including but not limited to the following content. +``` +### Maintainers + - sinever + - ZZZHB + - njlzk + - myeuler + - chxssg + +### Committers + - sinever + +### Mailing list + +### IRC Channel + +### Conference Information + +### External Contact +-Name (Gitee ID) +``` + diff --git a/sig/sig-ai-bigdata/sig-sig-ai-bigdata_cn.md b/sig/sig-ai-bigdata/sig-sig-ai-bigdata_cn.md new file mode 100644 index 000000000..2b481c084 --- /dev/null +++ b/sig/sig-ai-bigdata/sig-sig-ai-bigdata_cn.md @@ -0,0 +1,72 @@ + +# 新建SIG申请 +[English](./sig-ai-bigdata.md) | 简体中文 + + +说明：本SIG的Charter内容遵循openEuler章程 [README](/zh/governance/README.md)中描述的约定，使用[SIG-governance](/zh/technical-committee/governance/SIG-governance.md)中概述的角色和组织管理。 + +## SIG组工作目标和范围 + + - sig-ai-bigdata的必要性 + - 大数据和人工智能已经深入到社会的很多领域，各行各业都可以用来提高生产力。工业界、 + 学术界之外也有众多爱好者，为了更好的支持科研院所、生产企业中爱好者、开发者在openeuler上更快更好的进行大数据和 + 人工智能的实践，open euler也需要具备大数据和人工智能的相关能力。 + - 将artificial intelligence和big data放在一起的原因 + - 一方面当大数据大规模用于生产时，人工智能还在实验阶段，另一方面，人工智能的普及也是从一个应用，一个部分逐步展开的， + 导致很多公司的大数据和人工智能从上到下都是两套甚至多套，形成割裂局面，而实际上，大数据的处理结果还可以用于模型训练，而模型的训练需要的样本也需要大数据技术进行预处理。 + 逐步意识到这个问题后，很多大数据工具有了模型训练和推理功能，如sparkml, flinkml，而众多人工智能框架也在逐渐增强数据处理能力，更是催生了submarine、tony这种大数据和人工智能的融合工具。 + 因此open euler里直接将大数据和人工智能放在一起考虑。 + - 该SIG的业务范围 + - openeuler中大数据和人工智能的基础运行能力，包括对各种芯片的支持和加速库，各种数据仓库，分析引擎，训练引擎，算法库，数据集等。 + - openeuler中大数据和人工智能的统一平台，将各种常用的工具软件集成提供统一的用户界面解决各种维护环境的痛苦，让大数据和人工智能在openeuler上更易上手，更好用。 + - openeuler中大数据和人工智能的性能优化，对通用软件在open euler上的性能优化 + - openeuler中大数据和人工智能的能力集成，新芯片和软件进入open euler时的支持 + + - 该SIG需要得到openEuler内哪些SIG的支持 + - 有些工具安装会有一些依赖包，另外在新硬件支持和性能优化过程中对内核各子系统也可能有依赖。 + + ### 该SIG管理的repository及描述 + +- 项目名称： + - 数据存储、缓存、查询 + - hdfs + - kafka + - hbase + - hive + - pular + - druid + - 数据分析框架与库 + - spark + - flink + - mapreduce + - beam + - pandas + - numpy + - 模型训练与推理 + - tensorflow + - caffe + - scikit-learn + - pytorch + - libsvm + - mkl + - neon + - dlib + - daal + - 开发环境 + - jupyter + - zeppelin + - 资源管理 + - kubernetes + - mesos + - yarn + - 待补充 + + + ### 跨领域和面向外部的流程 + + 由该SIG定义和执行的，且跨领域和面向外部的流程和行动： + + - 非内部流程清单 + - 该SIG拥有的面向整个openEulerSIG的组织指导计划等 + + -- Gitee From f2e250cf4bf36274eee6210c0fe218455428ca9e Mon Sep 17 00:00:00 2001 From: zhengxian Date: Mon, 2 Mar 2020 15:23:43 +0800 Subject: [PATCH 3/3] update sig-ai-bigdata --- .../OWNERS | 6 - .../README.md | 56 ---------- ...ig-artificial-intelligence-and-big-data.md | 104 ------------------ ...artificial-intelligence-and-big-data_cn.md | 72 ------------ 4 files changed, 238 deletions(-) delete mode 100644 sig/sig-artificial-intelligence-and-big-data/OWNERS delete mode 100644 sig/sig-artificial-intelligence-and-big-data/README.md delete mode 100644 sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md delete mode 100644 sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md diff --git a/sig/sig-artificial-intelligence-and-big-data/OWNERS b/sig/sig-artificial-intelligence-and-big-data/OWNERS deleted file mode 100644 index e6a26b14a..000000000 --- a/sig/sig-artificial-intelligence-and-big-data/OWNERS +++ /dev/null @@ -1,6 +0,0 @@ -maintainers: - - sinever - - ZZZHB - - njlzk - - myeuler - - chxssg \ No newline at end of file diff --git a/sig/sig-artificial-intelligence-and-big-data/README.md b/sig/sig-artificial-intelligence-and-big-data/README.md deleted file mode 100644 index 4c438a3d6..000000000 --- a/sig/sig-artificial-intelligence-and-big-data/README.md +++ /dev/null @@ -1,56 +0,0 @@ -# sig-artificial-intelligence-and-big-data - - 大数据和人工智能已经深入到社会的很多领域，各行各业都可以用来提高生产力。工业界、学术界之外也有众多爱好者，为了更好的支持科研院所、生产企业中爱好者、开发者在openeuler上更快更好的进行大数据和人工智能的实践，open euler也需要具备大数据和人工智能的相关能力。 - - 将artificial intelligence和big data放在一起的原因 - - 一方面当大数据大规模用于生产时，人工智能还在实验阶段，另一方面，人工智能的普及也是从一个应用，一个部分逐步展开的， - 导致很多公司的大数据和人工智能从上到下都是两套甚至多套，形成割裂局面，而实际上，大数据的处理结果还可以用于模型训练，而模型的训练需要的样本也需要大数据技术进行预处理。 - 逐步意识到这个问题后，很多大数据工具有了模型训练和推理功能，如sparkml, flinkml，而众多人工智能框架也在逐渐增强数据处理能力，更是催生了submarine、tony这种大数据和人工智能的融合工具。 - 因此open euler里直接将大数据和人工智能放在一起考虑。 - - 该SIG的业务范围 - - openeuler中大数据和人工智能的基础运行能力，包括对各种芯片的支持和加速库，各种数据仓库，分析引擎，训练引擎，算法库，数据集等。 - - openeuler中大数据和人工智能的统一平台，将各种常用的工具软件集成提供统一的用户界面解决各种维护环境的痛苦，让大数据和人工智能在openeuler上更易上手，更好用。 - - openeuler中大数据和人工智能的性能优化，对通用软件在openeuler上的性能优化 - - openeuler中大数据和人工智能的能力集成，新芯片和软件进入openeuler时的支持 - -# 会议 - -- 每周五上午11：00 - 11：30 -- 线上 -- ZOOM地址：https://zoom.com.cn/j/558675882 - -# 成员 - -### Maintainer列表 - - sinever - - ZZZHB - - njlzk - - myeuler - - chxssg - -### Committer列表 - -- sinever - - -# 联系方式 - -*<如果需要单独申请邮件列表，请在此补充邮箱名称：sig-yousigname@openeuler.org>* - -- [邮件列表](sig-yoursigname@openeuler.org) -- [IRC公开会议]() -- [slack](openeuler.slack.com) - - - - - -# 项目清单 - -*<项目名称和申请表格一致，具体地址可以在申请下来以后在刷新>* - -项目名称： - -repository地址： - -- -- \ No newline at end of file diff --git a/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md b/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md deleted file mode 100644 index 3bc613fd8..000000000 --- a/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data.md +++ /dev/null @@ -1,104 +0,0 @@ - -# Application to create a new SIG -English | [简体中文](./sig-artificial-intelligence-and-big-data_cn.md) - - -Note: The Charter of this SIG follows the convention described in the openEuler charter [README] (/en/governance/README.md), and follows [SIG-governance] (/en/technical-committee/governance/SIG-governance.md). - -## SIG Mission and Scope - -- Why we create sig-artificial-intelligence-and-big-data in openEuler - - Big data and artificial intelligence have penetrated into many areas of our society, and used to improve productivity in many industries. - There are lots of enthusiasts outside the industrial and academic circles. - It is necessary to provide big data and artificial intelligence-related capabilities in open euler for scientists in research institutes and enthusiasts to implement big data and artificial intelligence on open euler, - -- Why we keep artificial intelligence and big data together - - On the one hand, when big data is used in production on a large scale, artificial intelligence is still in the experimental stage, on the other hand, the popularization of artificial intelligence is gradually being imported from one application to another, leading to a split situation of the big data and artificial intelligence in many companies. - In fact, the processing results of big data can then be used for model training, and the samples required for model training also require big data technology for preprocessing. - After gradually realizing this, many big data tools have model training and inference functions, such as sparkml for spark, flinkml for flink, and many artificial intelligence frameworks are gradually enhancing their data processing capabilities, which has also spawned a few fusion tools such as big data and tony. - Therefore, big data and artificial intelligence are directly considered together in open euler. - -- The scope of the SIG - - Basic capabilities of big data and artificial intelligence in open euler, including but not limited to supporting and accelerating libraries for various chips, various data warehouses, analysis engines, training engines, algorithm libraries, data sets, etc. - - A unified platform for big data and artificial intelligence in open euler, integrating various commonly used tools and software to provide a unified user interface to make big data and artificial intelligence easier and better to use on open euler. - - Performance optimization of big data and artificial intelligence in open euler. - - Integration of big data and artificial intelligence capabilities in open euler, supporting new chips and softwares in open euler - -- Which SIGs in openEuler to coorperate with - - Some tool may have some dependency packages, and in addition, they may have dependencies on kernel subsystems during new hardware support and performance optimization. - -### Deliverables -- Source and tar -  -### Repositories and description managed by this SIG - -- project name: - - data store, cache, query - - hdfs - - kafka - - hbase - - hive - - pular - - druid - - framework and library for data analysis - - spark - - flink - - mapreduce - - beam - - pandas - - numpy - - model training and predicting - - tensorflow - - caffe - - scikit-learn - - pytorch - - libsvm - - mkl - - neon - - dlib - - daal - - develop environment - - jupyter - - zeppelin - - resource management - - kubernetes - - mesos - - yarn - - to be continued - -### Cross-domain and external-oriented processes - -Cross-domain and externally-oriented processes and actions defined and implemented by this SIG: - -- Non-Internal Process Checklist - -- The organization guidance plan for the entire openEulerSIG owned by this SIG, etc. - - -## Basic Information - -### Project Introduction -    https: /gitee.com/openeuler/community/sig/sig-xxxx/ - -***Tips***: After the SIG is successfully created, https: /gitee.com/openeuler/community/sig/sig-xxxx/ management will be managed by the Maintainer, and the project team can enrich their project introduction, including but not limited to the following content. -``` -### Maintainers - - sinever - - ZZZHB - - njlzk - - myeuler - - chxssg - -### Committers - - sinever - -### Mailing list - -### IRC Channel - -### Conference Information - -### External Contact --Name (Gitee ID) -``` - diff --git a/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md b/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md deleted file mode 100644 index 2e8ae341c..000000000 --- a/sig/sig-artificial-intelligence-and-big-data/sig-artificial-intelligence-and-big-data_cn.md +++ /dev/null @@ -1,72 +0,0 @@ - -# 新建SIG申请 -[English](./sig-template.md) | 简体中文 - - -说明：本SIG的Charter内容遵循openEuler章程 [README](/zh/governance/README.md)中描述的约定，使用[SIG-governance](/zh/technical-committee/governance/SIG-governance.md)中概述的角色和组织管理。 - -## SIG组工作目标和范围 - - - sig-artificial-intelligence-and-big-data的必要性 - - 大数据和人工智能已经深入到社会的很多领域，各行各业都可以用来提高生产力。工业界、 - 学术界之外也有众多爱好者，为了更好的支持科研院所、生产企业中爱好者、开发者在openeuler上更快更好的进行大数据和 - 人工智能的实践，open euler也需要具备大数据和人工智能的相关能力。 - - 将artificial intelligence和big data放在一起的原因 - - 一方面当大数据大规模用于生产时，人工智能还在实验阶段，另一方面，人工智能的普及也是从一个应用，一个部分逐步展开的， - 导致很多公司的大数据和人工智能从上到下都是两套甚至多套，形成割裂局面，而实际上，大数据的处理结果还可以用于模型训练，而模型的训练需要的样本也需要大数据技术进行预处理。 - 逐步意识到这个问题后，很多大数据工具有了模型训练和推理功能，如sparkml, flinkml，而众多人工智能框架也在逐渐增强数据处理能力，更是催生了submarine、tony这种大数据和人工智能的融合工具。 - 因此open euler里直接将大数据和人工智能放在一起考虑。 - - 该SIG的业务范围 - - openeuler中大数据和人工智能的基础运行能力，包括对各种芯片的支持和加速库，各种数据仓库，分析引擎，训练引擎，算法库，数据集等。 - - openeuler中大数据和人工智能的统一平台，将各种常用的工具软件集成提供统一的用户界面解决各种维护环境的痛苦，让大数据和人工智能在openeuler上更易上手，更好用。 - - openeuler中大数据和人工智能的性能优化，对通用软件在openeuler上的性能优化 - - openeuler中大数据和人工智能的能力集成，新芯片和软件进入openeuler时的支持 - - - 该SIG需要得到openEuler内哪些SIG的支持 - - 有些工具安装会有一些依赖包，另外在新硬件支持和性能优化过程中对内核各子系统也可能有依赖。 - - ### 该SIG管理的repository及描述 - -- 项目名称： - - 数据存储、缓存、查询 - - hdfs - - kafka - - hbase - - hive - - pular - - druid - - 数据分析框架与库 - - spark - - flink - - mapreduce - - beam - - pandas - - numpy - - 模型训练与推理 - - tensorflow - - caffe - - scikit-learn - - pytorch - - libsvm - - mkl - - neon - - dlib - - daal - - 开发环境 - - jupyter - - zeppelin - - 资源管理 - - kubernetes - - mesos - - yarn - - 待补充 - - - ### 跨领域和面向外部的流程 - - 由该SIG定义和执行的，且跨领域和面向外部的流程和行动： - - - 非内部流程清单 - - 该SIG拥有的面向整个openEulerSIG的组织指导计划等 - - -- Gitee