From 47acacec1f65f1a8f25359d1743fc968f7c8d49a Mon Sep 17 00:00:00 2001 From: zhouxq <342239412@qq.com> Date: Tue, 11 Mar 2025 10:12:54 +0800 Subject: [PATCH] =?UTF-8?q?=E3=80=90master=E3=80=91=E3=80=90docs=E3=80=91?= =?UTF-8?q?=E6=9B=B4=E6=96=B0MindSpore=E5=AE=98=E7=BD=91VLMEvalKit?= =?UTF-8?q?=E8=AF=84=E6=B5=8B=E6=96=87=E6=A1=A3=EF=BC=8C=E6=B7=BB=E5=8A=A0?= =?UTF-8?q?PROTOCOL=5FBUFFERS=5FPYTHON=5FIMPLEMENTATION=E7=8E=AF=E5=A2=83?= =?UTF-8?q?=E5=8F=98=E9=87=8F?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- docs/mindformers/docs/source_en/usage/evaluation.md | 12 ++++++++++-- .../docs/source_zh_cn/usage/evaluation.md | 12 ++++++++++-- 2 files changed, 20 insertions(+), 4 deletions(-) diff --git a/docs/mindformers/docs/source_en/usage/evaluation.md b/docs/mindformers/docs/source_en/usage/evaluation.md index 31e8924df2..769551f360 100644 --- a/docs/mindformers/docs/source_en/usage/evaluation.md +++ b/docs/mindformers/docs/source_en/usage/evaluation.md @@ -240,6 +240,16 @@ Users can follow the following steps to compile and install: #### Launching a Single-Card Evaluation Script +Before performing the evaluation, please set the environment variables to exclude the influence of protobuf version on the evaluation. Execute the following command: + +```shell +export PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python +``` + +Execute script path: [eval_with_vlmevalkit.py](https://gitee.com/mindspore/mindformers/blob/dev/toolkit/benchmarks/eval_with_vlmevalkit.py) + +Execute the following command for evaluation: + ```shell #!/bin/bash @@ -252,8 +262,6 @@ python eval_with_vlmevalkit.py \ --config-path /{path}/config_path ``` -Execute script path: [eval_with_vlmevalkit.py](https://gitee.com/mindspore/mindformers/blob/dev/toolkit/benchmarks/eval_with_vlmevalkit.py) - #### Evaluation Parameters | Parameters | Type | Descriptions | Compulsory(Y/N)| diff --git a/docs/mindformers/docs/source_zh_cn/usage/evaluation.md b/docs/mindformers/docs/source_zh_cn/usage/evaluation.md index fe2a068f8e..2cd80debd9 100644 --- a/docs/mindformers/docs/source_zh_cn/usage/evaluation.md +++ b/docs/mindformers/docs/source_zh_cn/usage/evaluation.md @@ -239,6 +239,16 @@ Harness评测支持单机单卡、单机多卡、多机多卡场景,每种场 #### 启动单卡评测脚本 +执行评测前请先设置环境变量,排除protobuf版本对评测的影响,执行以下命令: + +```shell +export PROTOCOL_BUFFERS_PYTHON_IMPLEMENTATION=python +``` + +执行脚本路径:[eval_with_vlmevalkit.py](https://gitee.com/mindspore/mindformers/blob/dev/toolkit/benchmarks/eval_with_vlmevalkit.py) + +执行以下命令进行评测: + ```shell #!/bin/bash @@ -251,8 +261,6 @@ python eval_with_vlmevalkit.py \ --config-path /{path}/config_path ``` -执行脚本路径:[eval_with_vlmevalkit.py](https://gitee.com/mindspore/mindformers/blob/dev/toolkit/benchmarks/eval_with_vlmevalkit.py) - #### 评测参数 | 参数 | 类型 | 参数介绍 | 是否必须 | -- Gitee