diff --git a/PyTorch/built-in/rl/OpenRLHF_v0.6.2_for_PyTorch/README.osc.md b/PyTorch/built-in/rl/OpenRLHF_v0.6.2_for_PyTorch/README.osc.md index 6dd1923d8bc7fe00fd184500be5db4ef538f4aac..3cf955f829f6ca409289b78b2ef87d7c6a2ca6ab 100644 --- a/PyTorch/built-in/rl/OpenRLHF_v0.6.2_for_PyTorch/README.osc.md +++ b/PyTorch/built-in/rl/OpenRLHF_v0.6.2_for_PyTorch/README.osc.md @@ -53,15 +53,20 @@ OpenRLHF是一个基于Ray、DeepSpeed和HF Transformers构建的高性能RLHF * 安装vLLM和vLLM Ascend ```shell + source /usr/local/Ascend/ascend-toolkit/set_env.sh + source /usr/local/Ascend/nnal/atb/set_env.sh + git clone -b v0.7.3 https://github.com/vllm-project/vllm.git cd vllm pip install -r requirements-build.txt VLLM_TARGET_DEVICE=empty pip install . - + cd .. + git clone -b v0.7.3 https://github.com/vllm-project/vllm-ascend.git cd vllm-ascend sed -i '14,15s/^/#/' pyproject.toml # 已经在前面步骤安装torch和torch-npu,将其注释 pip install -e . + cd .. ``` * 安装OpenRLHF