代码拉取完成,页面将自动刷新
同步操作将从 Ascend/MindSpeed-Core-MS 强制同步,此操作会覆盖自 Fork 仓库以来所做的任何修改,且无法恢复!!!
确定后同步将在后台操作,完成时将刷新页面,请耐心等待。
#!/bin/bash
echo "===========================================start convert==========================================="
rm -rf MindSpeed-LLM/
git clone -b 1.0.0 https://gitee.com/ascend/MindSpeed-LLM.git --depth=1
if [ $? -ne 0 ]; then
echo "Error:git clone MindSpeed-LLM failed"
exit 1
fi
echo "------------------------------------done MindSpeed-LLM"
rm -rf MindSpeed/
git clone https://gitee.com/ascend/MindSpeed.git
if [ $? -ne 0 ]; then
echo "Error:git clone MindSpeed failed"
exit 1
fi
cd MindSpeed
git checkout 969686ff
cd ..
echo "...............................................done apply MindSpeed"
rm -rf Megatron-LM/
git clone -b core_r0.6.0 https://github.com/NVIDIA/Megatron-LM.git --depth=1
if [ $? -ne 0 ]; then
echo "Error:git clone Megatron-LM failed"
exit 1
fi
echo "------------------------------------done Megatron-LM"
rm -rf transformers/
git clone -b v4.47.0 https://github.com/huggingface/transformers.git --depth=1
if [ $? -ne 0 ]; then
echo "Error:git clone transformers failed"
exit 1
fi
echo "------------------------------------done transformers"
rm -rf peft/
git clone -b v0.7.1 https://github.com/huggingface/peft.git --depth=1
if [ $? -ne 0 ]; then
echo "Error:git clone peft failed"
exit 1
fi
echo "------------------------------------done peft"
pip install -r requirements.txt
echo "..............................................done install requirements"
python tools/transfer.py --megatron_path Megatron-LM/ --mindspeed_path MindSpeed/ --mindspeed_llm_path MindSpeed-LLM/ \
--transformers_path transformers/ --mindspeed_type LLM
MindSpeed_Core_MS_PATH=$(pwd)
export PYTHONPATH=${MindSpeed_Core_MS_PATH}/msadaptor:${MindSpeed_Core_MS_PATH}/Megatron-LM/:${MindSpeed_Core_MS_PATH}/MindSpeed/:${MindSpeed_Core_MS_PATH}/transformers/src/:$PYTHONPATH
export PYTHONPATH=${MindSpeed_Core_MS_PATH}/peft/src/:$PYTHONPATH
echo "..............................................done set PYTHONPATH"
echo "===========================================finish convert==========================================="
此处可能存在不合适展示的内容,页面不予展示。您可通过相关编辑功能自查并修改。
如您确认内容无涉及 不当用语 / 纯广告导流 / 暴力 / 低俗色情 / 侵权 / 盗版 / 虚假 / 无价值内容或违法国家有关法律法规的内容,可点击提交进行申诉,我们将尽快为您处理。