diff --git a/figures/Arts_arts001.png b/figures/Arts_arts001.png new file mode 100644 index 0000000000000000000000000000000000000000..17f387bcf090873fb7197c0efe8fffd902ab2fca Binary files /dev/null and b/figures/Arts_arts001.png differ diff --git a/figures/Arts_arts002.png b/figures/Arts_arts002.png new file mode 100644 index 0000000000000000000000000000000000000000..dfcc06843362eaa4043a59f57967237266d29431 Binary files /dev/null and b/figures/Arts_arts002.png differ diff --git a/figures/Arts_arts003.png b/figures/Arts_arts003.png new file mode 100644 index 0000000000000000000000000000000000000000..f9b51fb68aadf78d65019e1c63ffcc6437a23294 Binary files /dev/null and b/figures/Arts_arts003.png differ diff --git a/figures/Arts_as002.png b/figures/Arts_as002.png new file mode 100644 index 0000000000000000000000000000000000000000..37e325be294d48f319e374bee8504b37716157bd Binary files /dev/null and b/figures/Arts_as002.png differ diff --git a/figures/Arts_as003.png b/figures/Arts_as003.png new file mode 100644 index 0000000000000000000000000000000000000000..851baa2a2c13fdd2422ee92e7978a0873159c0a5 Binary files /dev/null and b/figures/Arts_as003.png differ diff --git a/figures/Arts_ascendmodel.png b/figures/Arts_ascendmodel.png new file mode 100644 index 0000000000000000000000000000000000000000..d32b65f56d433c773f446e38cd8050631329c555 Binary files /dev/null and b/figures/Arts_ascendmodel.png differ diff --git a/figures/Arts_doc003.png b/figures/Arts_doc003.png new file mode 100644 index 0000000000000000000000000000000000000000..9aa4476cf5fa1e50f71328d3f0718b7a4492ca6b Binary files /dev/null and b/figures/Arts_doc003.png differ diff --git a/figures/Arts_dockerPull.png b/figures/Arts_dockerPull.png new file mode 100644 index 0000000000000000000000000000000000000000..427f80f3eacac0f5e0b8553bf4731aef97820c69 Binary files /dev/null and b/figures/Arts_dockerPull.png differ diff --git a/figures/Arts_dockerPush.png b/figures/Arts_dockerPush.png new file mode 100644 index 0000000000000000000000000000000000000000..42e3b0fec6c032002c57983032b7bd22e73fcd20 Binary files /dev/null and b/figures/Arts_dockerPush.png differ diff --git a/figures/Arts_m001.png b/figures/Arts_m001.png new file mode 100644 index 0000000000000000000000000000000000000000..c31d6f7bce7a0a7ecbf41d879babedb5952c7eb4 Binary files /dev/null and b/figures/Arts_m001.png differ diff --git a/figures/Arts_m002.png b/figures/Arts_m002.png new file mode 100644 index 0000000000000000000000000000000000000000..88ba81b6c109de526b1d425a9f5c6789eaa6c698 Binary files /dev/null and b/figures/Arts_m002.png differ diff --git a/figures/Arts_m003.png b/figures/Arts_m003.png new file mode 100644 index 0000000000000000000000000000000000000000..34723ef4a542c4e7513af49d09c93bb358bdec42 Binary files /dev/null and b/figures/Arts_m003.png differ diff --git a/figures/Arts_ob001.png b/figures/Arts_ob001.png new file mode 100644 index 0000000000000000000000000000000000000000..7f9bc32b7dd4ff1b89b71d561f8c2cd62cd507b5 Binary files /dev/null and b/figures/Arts_ob001.png differ diff --git a/figures/Arts_ob002.png b/figures/Arts_ob002.png new file mode 100644 index 0000000000000000000000000000000000000000..07c0f69ea587a9a61c995c021126e8cafe75a2cc Binary files /dev/null and b/figures/Arts_ob002.png differ diff --git a/figures/Arts_tag001.png b/figures/Arts_tag001.png new file mode 100644 index 0000000000000000000000000000000000000000..fc4657e114b5eaa60723cb4752b55e0101f0222d Binary files /dev/null and b/figures/Arts_tag001.png differ diff --git a/figures/Arts_tag002.png b/figures/Arts_tag002.png new file mode 100644 index 0000000000000000000000000000000000000000..f3eb61574f0644a6bcb4300e4eab9572b40d282a Binary files /dev/null and b/figures/Arts_tag002.png differ diff --git a/figures/Arts_tag003.png b/figures/Arts_tag003.png new file mode 100644 index 0000000000000000000000000000000000000000..f8ff06be9a2dad9b8e8715216f3a44a514e148be Binary files /dev/null and b/figures/Arts_tag003.png differ diff --git "a/modelArts\344\275\277\347\224\250\346\214\207\345\215\227.md" "b/modelArts\344\275\277\347\224\250\346\214\207\345\215\227.md" new file mode 100644 index 0000000000000000000000000000000000000000..c3cd7717e26a70c2bf217961689d92be6d4597c1 --- /dev/null +++ "b/modelArts\344\275\277\347\224\250\346\214\207\345\215\227.md" @@ -0,0 +1,126 @@ +# modelArts使用指导 + +- [准备1 获取modelArts的docker 镜像](# 准备1 获取modelArts的docker 镜像) +- [准备2 获取一个modelzoo上能用的模型源码](# 准备2 获取一个modelzoo上能用的模型源码) +- [准备3 上传模型的脚本和所需的数据集](# 准备3 上传模型的脚本和所需的数据集) +- [创建modelArts训练任务](# 创建modelArts训练任务) + +## 准备1 获取modelArts的docker 镜像 + +确定自己有华为云账号,没有请去注册一个。 +1.登陆华为镜像仓下载 ascend-pytorch-arm-modelarts 镜像 + +```txt +https://ascendhub.huawei.com/#/index +``` + +Image_txt + +Image_txt + +点击下载会提示你使用docker pull和push + +2.准备一台安装有docker的机器,且保证磁盘空间由10G以上的空余 + + + +Image_txt + + + +Image_txt + +可能存在如下报错,需要重新,在页面上点击下获取,然后再pull + +Image_txt + +3.登陆华为云容器服务,点击客户端上传,根据需求给第二步下载镜像改名用docker tag命令改名 + +``` +https://console.huaweicloud.com/swr/?region=cn-east-3#/app/dashboard +``` + +Image_txt + +这里若自己还未存在组织,点击下方请上传,建立一个组织 + +Image_txt + +Image_txt + + + +4.上传第二步获取的docker镜像 + +Image_txt + +## 准备2 获取一个modelzoo上能用的模型源码 + +在下面的链接中选择一个pytorch的release的模型,这里以ShuffleNetV2为例 + +``` +https://www.hiascend.com/software/modelzoo +``` + +Image_txt + +下载脚本,这里重打创建作业处有说明命令使用方式,后面我们会用上。 + +Image_txt + +## 准备3 上传模型的脚本和所需的数据集 + +1.若没有安装obs,安装obs,在华为云中搜索obs可以下载。使用华为云账号登陆。 + +Image_txt + +2. 创建桶分别上传模型脚本和数据集,这里我使用的是公共路径obs的数据集,所以没有单独上传数据集 + +Image_txt + +## 创建modelArts训练任务 + +1.登陆华为云ModelArts + +``` + https://console.huaweicloud.com/modelarts/?region=cn-north-4&locale=zh-cn#/trainingJobs/1003888/detail +``` + +选择创建 + +Image_txt + +配置如下图 + +Image_txt + +Image_txt + +这里的运行命令如下作为参考 + +```bash +/bin/bash run_train.sh 'obs://workplace/Shufflenetv2_for_PyTorch_1.2_code/' 'Shufflenetv2_for_PyTorch_1.2_code/modelarts/train_start.py' '/tmp/log/training.log' --data_url='obs://ascend-test-dataset/imagenet/' --train_url='obs://workplace/oneOut' +``` + +命令分析 + +​ 'obs://workplace/Shufflenetv2_for_PyTorch_1.2_code/' 是你的obs中存放的 Shufflenetv2 的code位置 + + 'Shufflenetv2_for_PyTorch_1.2_code/modelarts/train_start.py' 这个脚本中封装了一层 modelarts ,选择里面的train_start.py + +--data_url 数据集位置 可以是你自己obs,这里采用了公共目录 + +--train_url 训练的工作目录,可以填写一个空目录 + +这个模型前期会把数据集从OBS拷贝到华为云,会比较耗时 + + + + + + + + + + +