From 5a13398e35d392936d8811ab50fa643415f8ceee Mon Sep 17 00:00:00 2001 From: adfnekc Date: Tue, 30 Jan 2024 15:10:48 +0000 Subject: [PATCH] add Tokenizer downlaod url Signed-off-by: adfnekc --- README.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/README.md b/README.md index 092f2a1..aa319e7 100644 --- a/README.md +++ b/README.md @@ -335,6 +335,11 @@ seq_length: 默认值是32768，SFT数据类型需要修改为：32769 - [iFlytekSpark_13b_chat_bf16](https://gitee.com/link?target=https%3A%2F%2Fascend-repo-modelzoo.obs.cn-east-2.myhuaweicloud.com%2FMindFormers%2Fiflytekspark%2Fiflytekspark_13b_chat_bf16.ckpt) - [iFlytekSpark_13b_chat_fp16](https://gitee.com/link?target=https%3A%2F%2Fascend-repo-modelzoo.obs.cn-east-2.myhuaweicloud.com%2FMindFormers%2Fiflytekspark%2Fiflytekspark_13b_chat_fp16.ckpt) +Tokenizer： + +- [tokenizer.model](https://ascend-repo-modelzoo.obs.cn-east-2.myhuaweicloud.com/MindFormers/iflytekspark/tokenizer.model) +- [tokenizer.vocab](https://ascend-repo-modelzoo.obs.cn-east-2.myhuaweicloud.com/MindFormers/iflytekspark/tokenizer.vocab) + **注**：本仓开源的权重包含Float16和BFloat16两种格式。`/research/iflytekspark/weight_convert.py`脚本用于将已有MindSpore权重进行数据类型的转换。 ``` -- Gitee