diff --git a/PyTorch/built-in/foundation/FlagAI/public_address_statement.md b/PyTorch/built-in/foundation/FlagAI/public_address_statement.md new file mode 100644 index 0000000000000000000000000000000000000000..63c05c4b83623b531b8ee9bd597df086393eb80d --- /dev/null +++ b/PyTorch/built-in/foundation/FlagAI/public_address_statement.md @@ -0,0 +1,288 @@ +| 类型 | 开源代码地址 | 文件名 | 公网IP地址/公网URL地址/域名/邮箱地址 | 用途说明 | +| ---- | ------------ | ------ | ------------------------------------ | -------- | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/Dockerfile| FlagAI/Dockerfile | https://download.pytorch.org/whl/cu117 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/Dockerfile| FlagAI/Dockerfile | https://github.com/NVIDIA/apex | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/Dockerfile| FlagAI/Dockerfile | https://github.com/OpenBMB/BMTrain | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/.git/config| FlagAI/Dockerfile | https://github.com/FlagAI-Open/FlagAI.git | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/prepare_test.sh| FlagAI/prepare_test.sh | https://github.com/BAAI-OpenPlatform/checkpoints.git | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/setup.py| FlagAI/setup.py | open@baai.ac.cn | 开发者邮箱配置 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/.git/config| FlagAI/setup.py | https://github.com/FlagAI-Open/FlagAI | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/indexed_dataset/preprocess_data_args.py| FlagAI/flagai/data/dataset/indexed_dataset/preprocess_data_args.py | https://stackoverflow.com/questions/33139531/preserve-empty-lines-with-nltks-punkt-tokenizer | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_2_DATASET.md| FlagAI/flagai/data/dataset/superglue/dataset.py | https://super.gluebenchmark.com/tasks | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-b.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/CB.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/COPA.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/MultiRC.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/RTE.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WiC.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WSC.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/BoolQ.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/ReCoRD.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-g.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://storage.googleapis.com/cluebenchmark/tasks/afqmc_public.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://storage.googleapis.com/cluebenchmark/tasks/tnews_public.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/data/CoLA.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://storage.googleapis.com/cluebenchmark/tasks/cmrc2018_public.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/data/SST-2.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://www.microsoft.com/en-us/download/details.aspx?id=52398 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/data/QQP-clean.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/data/MNLI.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/data/MNLI.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/control.py | https://dl.fbaipublicfiles.com/glue/data/QNLIv2.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-b.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/CB.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/COPA.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/MultiRC.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/RTE.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WiC.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/WSC.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/BoolQ.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/ReCoRD.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://dl.fbaipublicfiles.com/glue/superglue/data/v2/AX-g.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://storage.googleapis.com/cluebenchmark/tasks/afqmc_public.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://storage.googleapis.com/cluebenchmark/tasks/tnews_public.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/superglue/control.py| FlagAI/flagai/data/dataset/superglue/properties.py | https://storage.googleapis.com/cluebenchmark/tasks/cmrc2018_public.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/bert_tokenizer.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-cased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/bert_tokenizer.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-large-cased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/bert_tokenizer.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-multilingual-uncased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/bert_tokenizer.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-multilingual-cased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/bert_tokenizer.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-chinese-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-cased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-large-cased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-multilingual-uncased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-multilingual-cased-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/bert_tokenizer.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-chinese-vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://huggingface.co/bert-base-uncased/resolve/main/vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://huggingface.co/bert-large-uncased/resolve/main/vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://huggingface.co/bert-base-chinese/resolve/main/vocab.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/bert/wordpiece.py | https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/README.md| FlagAI/flagai/data/tokenizer/clip/tokenizer.py | https://github.com/openai/CLIP | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_tokenizer.py| FlagAI/flagai/data/tokenizer/glm_10b_en/glm_10b_en_tokenizer.py | https://huggingface.co/gpt2/resolve/main/vocab.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_tokenizer.py| FlagAI/flagai/data/tokenizer/glm_10b_en/glm_10b_en_tokenizer.py | https://huggingface.co/gpt2/resolve/main/merges.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_large_ch/glm_large_ch.py| FlagAI/flagai/data/tokenizer/glm_large_ch/glm_large_ch.py | https://github.com/openai/gpt-2/ | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py| FlagAI/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py | https://github.com/huggingface/transformers/pull/2778 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py| FlagAI/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py | https://github.com/huggingface/transformers/issues/3788 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_large_ch/glm_large_ch.py| FlagAI/flagai/data/tokenizer/glm_large_ch/glm_large_ch.py | https://github.com/google/sentencepiece | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_large_ch/glm_large_ch.py| FlagAI/flagai/data/tokenizer/glm_large_ch/glm_large_ch.py | https://github.com/google/sentencepiece.git | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_large_en/wordpiece.py| FlagAI/flagai/data/tokenizer/glm_large_en/wordpiece.py | https://github.com/huggingface/pytorch-pretrained-BERT/blob/master/pytorch_pretrained_bert/tokenization.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/glm_large_en/wordpiece.py | https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/t5/t5_tokenizer.py | https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/diffusion_bert_tokenizer.py | https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/uni_tokenizer/tokenizer.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/tokenizer.py | https://en.wikipedia.org/wiki/Control_character | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/uni_tokenizer/tokenizer.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/tokenizer.py | https://www.fileformat.info/info/unicode/category/Cc/index.htm | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/uni_tokenizer/tokenizer.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/tokenizer.py | https://www.fileformat.info/info/unicode/category/Cf/index.htm | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/wp_tokenizer.py | https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/README.md| FlagAI/flagai/model/mm/clip_guohua/clip.py | https://github.com/openai/CLIP | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/tokenizer.py | https://github.com/huggingface/transformers/pull/2778 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py| FlagAI/flagai/data/tokenizer/uni_tokenizer/tokenizer.py | https://github.com/huggingface/transformers/issues/3788 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/bert/wordpiece.py| FlagAI/flagai/model/mm/clip_guohua/bert_tokenizer.py | https://en.wikipedia.org/wiki/CJK_Unified_Ideographs_ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/mm/clip_guohua/modeling_bert.py | https://arxiv.org/abs/1606.08415 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/mm/clip_guohua/modeling_bert.py | https://arxiv.org/abs/1606.08415 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/lm/x_transformer.py| FlagAI/flagai/model/mm/lm/x_transformer.py | https://github.com/lucidrains/x-transformers/tree/main/x_transformers | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/attention.py| FlagAI/flagai/model/mm/modules/attention.py | https://github.com/MatthieuTPHR/diffusers/blob/d80b531ff8060ec1ea982b65a1b8df70f73aa67c/src/diffusers/models/attention.py#L223 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/bert_model.py| FlagAI/flagai/model/mm/clip_guohua/modeling_bert.py | https://github.com/pytorch/pytorch/pull/5617 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/openaimodel.py| FlagAI/flagai/model/mm/Unets/Unet.py | https://github.com/openai/CLIP/blob/main/clip/model.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/openaimodel.py| FlagAI/flagai/model/mm/Unets/Unet.py | https://github.com/hojonathanho/diffusion/blob/1e0dceb3b3495bbe19116a5e1b3596cd0706c543/diffusion_tf/models/unet.py#L66 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/vision/layers/activations.py | https://arxiv.org/abs/1710.05941 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/vision/layers/activations.py | https://arxiv.org/abs/1908.08681 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/vision/layers/activations.py | https://arxiv.org/abs/1908.08681 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/activations.py| FlagAI/flagai/model/vision/layers/activations.py | https://github.com/digantamisra98/H-Mish/blob/0da20d4bc58e696b6803f2523c58d3c8a82782d0/README.md | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/vision/layers/activations_jit.py | https://arxiv.org/abs/1710.05941 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/vision/layers/activations_jit.py | https://arxiv.org/abs/1908.08681 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/activations.py| FlagAI/flagai/model/vision/layers/activations_jit.py | https://github.com/digantamisra98/H-Mish/blob/0da20d4bc58e696b6803f2523c58d3c8a82782d0/README.md | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/activations_me.py| FlagAI/flagai/model/vision/layers/activations_me.py | https://twitter.com/jeremyphoward/status/1188251041835315200 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/vision/layers/activations_me.py | https://arxiv.org/abs/1908.08681 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/dpm_solver/dpm_solver.py| FlagAI/flagai/model/mm/dpm_solver/dpm_solver.py | https://arxiv.org/abs/2006.11239 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/dpm_solver/dpm_solver.py| FlagAI/flagai/model/mm/dpm_solver/dpm_solver.py | https://arxiv.org/abs/2011.13456 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/peft_model.py| FlagAI/flagai/model/tools/peft/peft_model.py | https://github.com/huggingface/accelerate/pull/873/ | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/activations.py| FlagAI/flagai/model/vision/layers/activations_me.py | https://github.com/digantamisra98/H-Mish/blob/0da20d4bc58e696b6803f2523c58d3c8a82782d0/README.md | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/attention_pool2d.py| FlagAI/flagai/model/vision/layers/attention_pool2d.py | https://github.com/openai/CLIP/blob/3b473b0e682c091a9e53623eebc1ca1657385717/clip/model.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/attention_pool2d.py| FlagAI/flagai/model/vision/layers/attention_pool2d.py | https://github.com/openai/CLIP/blob/3b473b0e682c091a9e53623eebc1ca1657385717/clip/model.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://arxiv.org/abs/2101.11605 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://gist.github.com/aravindsrinivas/56359b79f0ce4449bcb04ab4b56a57a2 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://gist.github.com/aravindsrinivas/56359b79f0ce4449bcb04ab4b56a57a2 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://arxiv.org/abs/1904.09925 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/cbam.py| FlagAI/flagai/model/vision/layers/cbam.py | https://arxiv.org/abs/1807.06521 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://gist.github.com/aravindsrinivas/56359b79f0ce4449bcb04ab4b56a57a2 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://arxiv.org/abs/1904.09925 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/attention_pool2d.py| FlagAI/flagai/model/vision/layers/attention_pool2d.py | https://github.com/openai/CLIP/blob/3b473b0e682c091a9e53623eebc1ca1657385717/clip/model.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/bottleneck_attn.py | https://arxiv.org/abs/2101.11605 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/cond_conv2d.py| FlagAI/flagai/model/vision/layers/cond_conv2d.py | https://arxiv.org/abs/1904.04971 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/cond_conv2d.py| FlagAI/flagai/model/vision/layers/cond_conv2d.py | https://github.com/tensorflow/tpu/blob/master/models/official/efficientnet/condconv/condconv_layers.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/cond_conv2d.py| FlagAI/flagai/model/vision/layers/cond_conv2d.py | https://github.com/pytorch/pytorch/issues/17983 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://arxiv.org/abs/1810.12890 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://arxiv.org/abs/1603.09382 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://github.com/tensorflow/tpu/blob/master/models/official/resnet/resnet_model.py#L74 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://github.com/clovaai/assembled-cnn/blob/master/nets/blocks.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/eca.py| FlagAI/flagai/model/vision/layers/eca.py | https://arxiv.org/abs/1910.03151 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/eca.py| FlagAI/flagai/model/vision/layers/eca.py | https://github.com/BangguWu/ECANet | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://arxiv.org/pdf/1810.12890.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/eca.py| FlagAI/flagai/model/vision/layers/eca.py | https://github.com/VRandme | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/eca.py| FlagAI/flagai/model/vision/layers/eca.py | https://arxiv.org/pdf/1910.03151.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://arxiv.org/pdf/1810.12890.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/evo_norm.py| FlagAI/flagai/model/vision/layers/evo_norm.py | https://arxiv.org/abs/2004.02967 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/evo_norm.py| FlagAI/flagai/model/vision/layers/evo_norm.py | https://proceedings.neurips.cc/paper/2020/file/9d4c03631b8b0c85ae08bf05eda37d0f-Paper.pdf | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://arxiv.org/pdf/1810.12890.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/eca.py| FlagAI/flagai/model/vision/layers/eca.py | https://arxiv.org/pdf/1910.03151.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/drop.py| FlagAI/flagai/model/vision/layers/drop.py | https://github.com/tensorflow/tpu/issues/494#issuecomment-532968956 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/eca.py| FlagAI/flagai/model/vision/layers/eca.py | https://github.com/pytorch/pytorch/pull/17240 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/filter_response_norm.py| FlagAI/flagai/model/vision/layers/filter_response_norm.py | https://arxiv.org/abs/1911.09737 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/gather_excite.py| FlagAI/flagai/model/vision/layers/gather_excite.py | https://arxiv.org/abs/1810.12348 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/gather_excite.py| FlagAI/flagai/model/vision/layers/gather_excite.py | https://github.com/hujie-frank/GENet | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/global_context.py| FlagAI/flagai/model/vision/layers/global_context.py | https://arxiv.org/abs/1904.11492 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/global_context.py| FlagAI/flagai/model/vision/layers/global_context.py | https://github.com/xvjiarui/GCNet | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/halo_attn.py| FlagAI/flagai/model/vision/layers/halo_attn.py | https://arxiv.org/abs/2103.12731 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/halo_attn.py | https://gist.github.com/aravindsrinivas/56359b79f0ce4449bcb04ab4b56a57a2 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/halo_attn.py | https://arxiv.org/abs/1904.09925 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/halo_attn.py | https://gist.github.com/aravindsrinivas/56359b79f0ce4449bcb04ab4b56a57a2 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/bottleneck_attn.py| FlagAI/flagai/model/vision/layers/halo_attn.py | https://arxiv.org/abs/1904.09925 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/inplace_abn.py| FlagAI/flagai/model/vision/layers/inplace_abn.py | https://github.com/mapillary/inplace_abn.git@v1.0.12 | 开发者邮箱配置 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/inplace_abn.py| FlagAI/flagai/model/vision/layers/inplace_abn.py | inplace_abn.git@v1.0.12 | 开发者邮箱配置 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/halo_attn.py| FlagAI/flagai/model/vision/layers/halo_attn.py | https://arxiv.org/abs/2103.12731 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/lambda_layer.py| FlagAI/flagai/model/vision/layers/lambda_layer.py | https://arxiv.org/abs/2102.08602 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/lambda_layer.py| FlagAI/flagai/model/vision/layers/lambda_layer.py | https://github.com/lucidrains/lambda-networks | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/lambda_layer.py| FlagAI/flagai/model/vision/layers/lambda_layer.py | https://arxiv.org/abs/2102.08602 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/mixed_conv2d.py| FlagAI/flagai/model/vision/layers/mixed_conv2d.py | https://arxiv.org/abs/1907.09595 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/mixed_conv2d.py| FlagAI/flagai/model/vision/layers/mixed_conv2d.py | https://github.com/tensorflow/tpu/blob/master/models/official/mnasnet/mixnet/custom_layers.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/non_local_attn.py| FlagAI/flagai/model/vision/layers/non_local_attn.py | https://openaccess.thecvf.com/content_CVPR_2020/html/Chi_Non-Local_Neural_Networks_With_Grouped_Bilinear_Attentional_Transforms_CVPR_2020_paper.html | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/non_local_attn.py| FlagAI/flagai/model/vision/layers/non_local_attn.py | https://github.com/BA-Transform/BAT-Image-Classification | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/mlp.py | ModelZoo-PyTorch/PyTorch/built-in/foundation/FlagAI/flagai/model/vision/layers/mlp.py | https://arxiv.org/abs/1612.08083 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/mlp.py | ModelZoo-PyTorch/PyTorch/built-in/foundation/FlagAI/flagai/model/vision/layers/mlp.py | https://arxiv.org/abs/2002.05202 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/non_local_attn.py| FlagAI/flagai/model/vision/layers/non_local_attn.py | https://github.com/BA-Transform/BAT-Image-Classification | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/non_local_attn.py| FlagAI/flagai/model/vision/layers/non_local_attn.py | https://github.com/facebookresearch/video-nonlocal-net | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/non_local_attn.py| FlagAI/flagai/model/vision/layers/non_local_attn.py | https://github.com/BA-Transform/BAT-Image-Classification | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/vit_cifar100/README.md| FlagAI/flagai/model/vision/layers/patch_embed.py | https://github.com/google-research/vision_transformer | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/selective_kernel.py| FlagAI/flagai/model/vision/layers/selective_kernel.py | https://arxiv.org/abs/1903.06586 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/selective_kernel.py| FlagAI/flagai/model/vision/layers/selective_kernel.py | https://arxiv.org/abs/1903.06586 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/split_attn.py| FlagAI/flagai/model/vision/layers/split_attn.py | https://arxiv.org/abs/2004.08955 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/split_attn.py| FlagAI/flagai/model/vision/layers/split_attn.py | https://github.com/zhanghang1989/ResNeSt | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/pos_embed.py| FlagAI/flagai/model/vision/layers/pos_embed.py | https://github.com/lucidrains/vit-pytorch/blob/6f3a5fcf0bca1c5ec33a35ef48d97213709df4ba/vit_pytorch/rvt.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/pos_embed.py| FlagAI/flagai/model/vision/layers/pos_embed.py | https://blog.eleuther.ai/rotary-embeddings/ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/squeeze_excite.py| FlagAI/flagai/model/vision/layers/squeeze_excite.py | https://arxiv.org/abs/1709.01507 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/squeeze_excite.py| FlagAI/flagai/model/vision/layers/squeeze_excite.py | https://arxiv.org/abs/1911.06667 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://github.com/joe-siyuan-qiao/WeightStandardization | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://arxiv.org/abs/2101.08692 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://github.com/deepmind/deepmind-research/tree/master/nfnets | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/squeeze_excite.py| FlagAI/flagai/model/vision/layers/squeeze_excite.py | https://arxiv.org/abs/1911.06667 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://arxiv.org/abs/1903.10520v2 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://arxiv.org/abs/1903.10520v2 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/weight_init.py| FlagAI/flagai/model/vision/layers/weight_init.py | https://people.sc.fsu.edu/~jburkardt/presentations/truncated_normal.pdf | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://arxiv.org/abs/2101.08692 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/std_conv.py| FlagAI/flagai/model/vision/layers/std_conv.py | https://arxiv.org/abs/2101.08692 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/openaimodel.py| FlagAI/flagai/model/mm/modules/diffusionmodules/openaimodel.py | https://github.com/openai/CLIP/blob/main/clip/model.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/util.py| FlagAI/flagai/model/mm/modules/diffusionmodules/util.py | https://github.com/openai/improved-diffusion/blob/main/improved_diffusion/gaussian_diffusion.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/util.py| FlagAI/flagai/model/mm/modules/diffusionmodules/util.py | https://github.com/lucidrains/denoising-diffusion-pytorch/blob/7706bdfc6f527f58d33f84b7b522e61e6e3164b3/denoising_diffusion_pytorch/denoising_diffusion_pytorch.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/util.py| FlagAI/flagai/model/mm/modules/diffusionmodules/util.py | https://github.com/openai/guided-diffusion/blob/0ba878e517b276c45d1195eb29f6f5f72659a05b/guided_diffusion/nn.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/util.py| FlagAI/flagai/model/mm/modules/diffusionmodules/util.py | https://arxiv.org/abs/2010.02502 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/openaimodel.py|ModelZoo-PyTorch/PyTorch/built-in/diffusion/stablediffusion-2.1/ldm/modules/karlo/kakao/modules/unet.py | https://github.com/hojonathanho/diffusion/blob/1e0dceb3b3495bbe19116a5e1b3596cd0706c543/diffusion_tf/models/unet.py#L66 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/attention.py| FlagAI/flagai/model/mm/modules/diffusionmodules/model.py | https://github.com/MatthieuTPHR/diffusers/blob/d80b531ff8060ec1ea982b65a1b8df70f73aa67c/src/diffusers/models/attention.py#L223 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/openaimodel.py| FlagAI/flagai/model/mm/modules/diffusionmodules/openaimodel.py | https://github.com/hojonathanho/diffusion/blob/1e0dceb3b3495bbe19116a5e1b3596cd0706c543/diffusion_tf/models/unet.py#L66 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/AltDiffusion.py| FlagAI/flagai/model/mm/modules/distributions/distributions.py | https://github.com/openai/guided-diffusion/blob/27c20a8fab9cb472df5d6bdd6c8d11c8f430b924/guided_diffusion/losses.py#L12 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adalora.py| FlagAI/flagai/model/tools/peft/tuners/adalora.py | https://openreview.net/pdf?id=lq62uWRJjiY | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adaption_prompt.py| FlagAI/flagai/model/tools/peft/tuners/adaption_prompt.py | https://github.com/huggingface/transformers/blob/1de8ce9ee1191ba761a593ac15d9ccbf5851bfc5/src/transformers/models/llama/modeling_llama.py#L126 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adaption_prompt.py| FlagAI/flagai/model/tools/peft/tuners/adaption_prompt.py | https://github.com/huggingface/transformers/blob/1de8ce9ee1191ba761a593ac15d9ccbf5851bfc5/src/transformers/models/llama/modeling_llama.py#L133 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adaption_prompt.py| FlagAI/flagai/model/tools/peft/tuners/adaption_prompt.py | https://github.com/huggingface/peft/pull/268 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adaption_prompt.py| FlagAI/flagai/model/tools/peft/tuners/adaption_prompt.py | https://arxiv.org/pdf/2303.16199.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adaption_prompt.py| FlagAI/flagai/model/tools/peft/tuners/adaption_prompt.py | https://github.com/ZrrSkywalker/LLaMA-Adapter/blob/41c3546fe1997ab8a65809dc8d8f9252b19d9faf/llama/model.py#L234 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adaption_prompt.py| FlagAI/flagai/model/tools/peft/tuners/adaption_prompt.py | https://github.com/ZrrSkywalker/LLaMA-Adapter/blob/41c3546fe1997ab8a65809dc8d8f9252b19d9faf/llama/model.py#L141 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/prefix_tuning.py| FlagAI/flagai/model/tools/peft/tuners/prefix_tuning.py | https://github.com/THUDM/P-tuning-v2/blob/main/model/prefix_encoder.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/adalora.py| FlagAI/flagai/model/tools/peft/tuners/adalora.py | https://openreview.net/pdf?id=lq62uWRJjiY | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/p_tuning.py| FlagAI/flagai/model/tools/peft/tuners/p_tuning.py | https://github.com/NVIDIA/NeMo/blob/main/nemo/collections/nlp/modules/common/prompt_encoder.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/utils/save_and_load.py| FlagAI/flagai/model/tools/peft/utils/save_and_load.py | https://github.com/microsoft/LoRA/blob/main/loralib/utils.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/lora.py| FlagAI/flagai/model/tools/peft/tuners/lora.py | https://github.com/microsoft/LoRA/blob/main/loralib/layers.py | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/tools/peft/tuners/lora.py| FlagAI/flagai/model/tools/peft/tuners/lora.py | https://github.com/bmaltais/kohya_ss/blob/feb6728762a8f463d15ba936d189d4c3abfaa1ab/networks/lora.py#L117 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/schedulers.py| FlagAI/flagai/schedulers.py | https://openreview.net/pdf?id=BJYwwY9ll | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/trainer.py| FlagAI/flagai/trainer.py | https://www.deepspeed.ai/docs/config-json/ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/trainer.py| FlagAI/flagai/trainer_v1.py | https://www.deepspeed.ai/docs/config-json/ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/dataset/indexed_dataset/preprocess_data_args.py| FlagAI/script/preprocess_data_flagai_args.py | https://stackoverflow.com/questions/33139531/preserve-empty-lines-with-nltks-punkt-tokenizer | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/file_utils.py| FlagAI/flagai/data/file_utils.py | https://github.com/huggingface/pytorch-pretrained-BERT | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/file_utils.py| FlagAI/flagai/data/file_utils.py | https://github.com/allenai/allennlp | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/fp16/fp16.py| FlagAI/flagai/fp16/fp16.py | https://github.com/pytorch/pytorch/issues/7733 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/fp16/fp16util.py| FlagAI/flagai/fp16/fp16util.py | http://on-demand.gputechconf.com/gtc/2018/video/S81012/ | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/fp16/fp16util.py| FlagAI/flagai/fp16/fp16util.py | http://pytorch.org/docs/master/_modules/torch/_utils.html | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/aquila2/modeling_aquila.py| FlagAI/flagai/model/aquila_modeling_hf.py | https://pytorch.org/docs/stable/nn.html#torch.nn.Module | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/bert_model.py| FlagAI/flagai/model/bert_model.py | https://github.com/pytorch/pytorch/pull/5617 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/aquila2/modeling_aquila.py| FlagAI/flagai/model/aquila_modeling_hf.py | https://arxiv.org/abs/1910.13461 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/file_utils.py| FlagAI/flagai/model/file_utils.py | https://model.baai.ac.cn/api/downloadCode | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/file_utils.py| FlagAI/flagai/model/file_utils.py | https://model.baai.ac.cn/api/downloadCode | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/file_utils.py| FlagAI/flagai/model/file_utils.py | https://model.baai.ac.cn/api/downloadCode | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/file_utils.py| FlagAI/flagai/model/file_utils.py | https://model.baai.ac.cn/api/searchModleByName | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/file_utils.py| FlagAI/flagai/model/file_utils.py | https://model.baai.ac.cn/api/searchModelFileByName | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/opt_model.py| FlagAI/flagai/model/opt_model.py | https://huggingface.co/models?filter=opt | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/fa19d69eafc9a482aff0b59ddd96b025c0cb207d/mesh_tensorflow/layers.py#L1624 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/master/mesh_tensorflow/transformer/transformer_layers.py#L56 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/fa19d69eafc9a482aff0b59ddd96b025c0cb207d/mesh_tensorflow/layers.py#L89 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/fa19d69eafc9a482aff0b59ddd96b025c0cb207d/mesh_tensorflow/transformer/attention.py#L136 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_8_ENVIRONMENT_SETUP.md| FlagAI/flagai/mpu/grads.py | https://github.com/pytorch/pytorch | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_8_ENVIRONMENT_SETUP.md| FlagAI/flagai/mpu/random.py | https://github.com/pytorch/pytorch | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/8d2465e9bc93129b913b5ccc6a59aa97abd96ec6/mesh_tensorflow | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/fa19d69eafc9a482aff0b59ddd96b025c0cb207d/mesh_tensorflow/layers.py#L666 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://github.com/tensorflow/mesh/blob/fa19d69eafc9a482aff0b59ddd96b025c0cb207d/mesh_tensorflow/layers.py#L666 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/t5_model.py| FlagAI/flagai/model/t5_model.py | https://huggingface.co/t5-small | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/Aquila/Aquila-server/post_request.py| FlagAI/examples/Aquila/Aquila-server/post_request.py | http://127.0.0.1 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/Aquila/Aquila-server/post_request.py| FlagAI/examples/Aquila/Aquila-server/post_request.py | http://127.0.0.1 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py| FlagAI/flagai/data/tokenizer/tokenizer.py | https://github.com/huggingface/transformers/pull/2778 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/data/tokenizer/glm_10b_en/glm_10b_en_bpe_tokenizer.py| FlagAI/flagai/data/tokenizer/tokenizer.py | https://github.com/huggingface/transformers/issues/3788 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1606.08415 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1606.08415 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://github.com/hendrycks/GELUs | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://github.com/hendrycks/GELUs | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/attentions.py| FlagAI/flagai/model/layers/attentions_bmt.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/2004.09602 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1606.08415 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1606.08415 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1702.03118 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1710.05941v1 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://arxiv.org/abs/1908.08681 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/activations.py| FlagAI/flagai/model/layers/activations.py | https://github.com/digantamisra98/Mish | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_8_ENVIRONMENT_SETUP.md| FlagAI/flagai/model/layers/embeddings.py | https://github.com/pytorch/pytorch | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_8_ENVIRONMENT_SETUP.md| FlagAI/flagai/model/layers/embeddings_bmt.py | https://github.com/pytorch/pytorch | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/attentions.py| FlagAI/flagai/model/layers/attentions.py | https://github.com/tensorflow/mesh/blob/0cb87fe07da627bf0b7e60475d59f95ed6b5be3d/mesh_tensorflow/transformer/transformer_layers.py#L593 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/global_pointer.py| FlagAI/flagai/model/layers/global_pointer.py | https://kexue.fm/archives/7359 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/layer_norm.py| FlagAI/flagai/model/layers/layer_norm_bmt.py | https://arxiv.org/abs/1607.06450 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/layer_norm.py| FlagAI/flagai/model/layers/layer_norm_bmt.py | https://arxiv.org/abs/1910.07467 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/layer_norm.py| FlagAI/flagai/model/layers/layer_norm.py | https://arxiv.org/abs/1607.06450 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/layer_norm.py| FlagAI/flagai/model/layers/layer_norm.py | https://arxiv.org/abs/1910.07467 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/attentions.py| FlagAI/flagai/model/layers/attentions.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/hf_altclip/modeling_altclip.py| FlagAI/flagai/model/mm/AltCLIP.py | http://images.cocodataset.org/val2017/000000039769.jpg | 相关数据集图片地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/hf_altclip/modeling_altclip.py| FlagAI/flagai/model/mm/AltCLIP.py | http://images.cocodataset.org/val2017/000000039769.jpg | 相关数据集图片地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/autoencoders.py| FlagAI/flagai/model/mm/autoencoders.py | https://github.com/pytorch/pytorch/issues/37142 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/README.md| FlagAI/flagai/model/mm/clip_model.py | https://github.com/openai/CLIP | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/clip_model.py| FlagAI/flagai/model/mm/clip_model.py | https://sachinruk.github.io/blog/pytorch/pytorch%20lightning/loss%20function/gpu/2021/03/07/CLIP.html | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/README.md| FlagAI/flagai/model/mm/eva_clip_model.py | https://github.com/openai/CLIP | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/eva_clip_model.py| FlagAI/flagai/model/mm/eva_clip_model.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/clip_model.py| FlagAI/flagai/model/mm/clip_model.py | https://arxiv.org/abs/2111.07991 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modeling_altclip.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://huggingface.co/xlm-roberta-base | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modeling_altclip.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://arxiv.org/abs/1803.02155 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modeling_altclip.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://arxiv.org/abs/2009.13658 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modeling_altclip.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://huggingface.co/models?filter=altclip | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/aquila2/modeling_aquila.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://pytorch.org/docs/stable/nn.html#torch.nn.Module | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/AltDiffusion.py| FlagAI/flagai/model/mm/AltDiffusion.py | https://github.com/openai/guided-diffusion/blob/27c20a8fab9cb472df5d6bdd6c8d11c8f430b924/guided_diffusion/losses.py#L12 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/clip_model.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://sachinruk.github.io/blog/pytorch/pytorch%20lightning/loss%20function/gpu/2021/03/07/CLIP.html | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/utils.py| FlagAI/flagai/model/mm/utils.py | https://github.com/openai/guided-diffusion/blob/27c20a8fab9cb472df5d6bdd6c8d11c8f430b924/guided_diffusion/nn.py#L86 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/modules/diffusionmodules/util.py| FlagAI/flagai/model/mm/utils.py | https://arxiv.org/abs/2010.02502 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/layers/attentions.py| FlagAI/flagai/model/mm/modeling_altclip.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/mm/utils.py| FlagAI/flagai/model/mm/utils.py | https://gist.github.com/crowsonkb/65f7265353f403714fce3b2595e0b298 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/predictor/README.md| FlagAI/flagai/model/predictor/simctg.py | https://github.com/yxuansu/SimCTG | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_6_INSTRUCTIONS_FOR_PREDICTOR.md| FlagAI/flagai/model/predictor/utils.py | https://arxiv.org/pdf/1909.05858.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/hf_altclip/modeling_altclip.py| FlagAI/flagai/model/mm/modeling_altclip.py | http://images.cocodataset.org/val2017/000000039769.jpg | 相关数据集图片地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/AltCLIP/hf_altclip/modeling_altclip.py| FlagAI/flagai/model/mm/modeling_altclip.py | http://images.cocodataset.org/val2017/000000039769.jpg | 相关数据集图片地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/swinv1.py| FlagAI/flagai/model/vision/swinv1.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_6_INSTRUCTIONS_FOR_PREDICTOR.md| FlagAI/flagai/model/predictor/predictor.py | http://arxiv.org/abs/1904.09751 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_6_INSTRUCTIONS_FOR_PREDICTOR.md| FlagAI/flagai/model/predictor/predictor.py | https://arxiv.org/pdf/1909.05858.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/predictor/utils.py| FlagAI/flagai/model/predictor/utils.py | https://github.com/facebookresearch/XLM/blob/9e6f6814d17be4fe5b15f2e6c43eb2b2d76daeb4/src/model/transformer.py#L529 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/vit.py| FlagAI/flagai/model/vision/vit.py | https://arxiv.org/abs/2010.11929 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/vit.py| FlagAI/flagai/model/vision/vit.py | https://arxiv.org/abs/2106.10270 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/vit_cifar100/README.md| FlagAI/flagai/model/vision/vit.py | https://github.com/google-research/vision_transformer | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/layers/pos_embed.py| FlagAI/flagai/model/vision/vit.py | https://github.com/lucidrains/vit-pytorch | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/vit.py| FlagAI/flagai/model/vision/vit.py | https://github.com/karpathy/minGPT | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/swinv1.py| FlagAI/flagai/model/vision/swinv1.py | https://arxiv.org/pdf/2103.14030 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/vit.py| FlagAI/flagai/model/vision/vit.py | https://arxiv.org/abs/2010.11929 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/docs/TUTORIAL_6_INSTRUCTIONS_FOR_PREDICTOR.md| FlagAI/flagai/model/predictor/utils.py | http://arxiv.org/abs/1904.09751 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/predictor/utils.py| FlagAI/flagai/model/predictor/utils.py | https://gist.github.com/thomwolf/1a5a29f6962089e871b94cbd09daf317 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/swinv1.py| FlagAI/flagai/model/vision/swinv2.py | https://arxiv.org/pdf/2103.14030 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/flagai/model/vision/vit.py| FlagAI/flagai/model/vision/vit.py | https://github.com/google-research/vision_transformer/blob/00883dd691c63a6830751563748663526e811cee/vit_jax/checkpoint.py#L224 | 源码实现 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/cpm3_generation/generation.py| FlagAI/flagai/model/predictor/utils.py | https://medium.com/huggingface/how-to-build-a-state-of-the-art-conversational-ai-with-transfer-learning-2d818ac26313 | 模型相关说明 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/cpm3_generation/generation.py| FlagAI/flagai/model/predictor/utils.py | https://arxiv.org/abs/1909.05858 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/cpm3_generation/generation.py| FlagAI/flagai/model/predictor/utils.py | https://arxiv.org/abs/1909.05858 | 参考论文地址 | +| 开源代码引入 | https://github.com/FlagAI-Open/FlagAI/blob/master/examples/cpm3_generation/generation.py| FlagAI/flagai/model/predictor/utils.py | https://github.com/pytorch/fairseq/blob/a07cb6f40480928c9e0548b737aadd36ee66ac76/fairseq/sequence_generator.py#L345 | 源码实现 | \ No newline at end of file diff --git a/PyTorch/built-in/nlp/Data2vec_for_PyTorch/public_address_statement.md b/PyTorch/built-in/nlp/Data2vec_for_PyTorch/public_address_statement.md new file mode 100644 index 0000000000000000000000000000000000000000..d6d4146d995cac91819bcf81a4bdf6011accebf6 --- /dev/null +++ b/PyTorch/built-in/nlp/Data2vec_for_PyTorch/public_address_statement.md @@ -0,0 +1,239 @@ +| 类型 | 开源代码地址 | 文件名 | 公网IP地址/公网URL地址/域名/邮箱地址 | 用途说明 | +| ---- | ------------ | ------ | ------------------------------------ | -------- | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/.gitmodules|Data2vec_for_PyTorch/.gitmodules | https://github.com/ngoyal2707/Megatron-LM | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/setup.py|Data2vec_for_PyTorch/setup.py | https://stackoverflow.com/a/54128391 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/setup.py|Data2vec_for_PyTorch/setup.py | https://download.pytorch.org/whl/cpu/torch-1.7.0%2Bcpu-cp36-cp36m-linux_x86_64.whl | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/setup.py|Data2vec_for_PyTorch/setup.py | https://bit.ly/2NLVsgE | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/.github/ISSUE_TEMPLATE.md|Data2vec_for_PyTorch/setup.py | https://github.com/pytorch/fairseq | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/data/audio/feature_transforms/specaugment.py|Data2vec_for_PyTorch/fairseq/data/audio/feature_transforms/specaugment.py | https://arxiv.org/abs/1904.08779 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/models/speech_dlm/modules/speech_dlm_decoder.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/models/speech_dlm/modules/speech_dlm_decoder_layer.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/models/speech_dlm/sequence_generator/multichannel_sequence_generator.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_dlm/sequence_generator/multichannel_search.py|Data2vec_for_PyTorch/fairseq/models/speech_dlm/sequence_generator/multichannel_search.py | https://arxiv.org/abs/1904.09751 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/modules/convolution.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/modules/convolution.py | https://arxiv.org/abs/1911.08460 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/modules/emformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/modules/emformer.py | https://arxiv.org/abs/1803.02155 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/modules/convolution.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/modules/convolution.py | https://github.com/espnet/espnet | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/modules/augmented_memory_attention.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/modules/augmented_memory_attention.py | https://arxiv.org/abs/2005.08042 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/modules/augmented_memory_attention.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/modules/augmented_memory_attention.py | https://arxiv.org/abs/2005.09137 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_dlm/sequence_generator/multichannel_sequence_generator.py|Data2vec_for_PyTorch/fairseq/models/speech_dlm/sequence_generator/multichannel_sequence_generator.py | https://discuss.pytorch.org/t/how-to-mask-and-assign-a-value-to-tensor/18437 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/modules/emformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/modules/emformer.py | https://arxiv.org/abs/2005.09684 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/conf.py|Data2vec_for_PyTorch/docs/conf.py | https://github.com/pytorch/fairseq/tree/main/docs/ | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/conf.py|Data2vec_for_PyTorch/docs/conf.py | http://docs.scipy.org/doc/numpy/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/conf.py|Data2vec_for_PyTorch/docs/conf.py | https://docs.python.org/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/conf.py|Data2vec_for_PyTorch/docs/conf.py | https://pytorch.org/docs/master/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/file_utils.py|Data2vec_for_PyTorch/fairseq/file_utils.py | https://github.com/allenai/allennlp | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.md|Data2vec_for_PyTorch/fairseq/file_utils.py | https://github.com/huggingface | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/checkpoint_utils.py|Data2vec_for_PyTorch/fairseq/checkpoint_utils.py | https://pypi.org/project/huggingface-hub/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/layerdrop/README.md|Data2vec_for_PyTorch/fairseq/checkpoint_utils.py | https://arxiv.org/abs/1909.11556 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/constrained_decoding/README.md|Data2vec_for_PyTorch/fairseq/search.py | https://www.aclweb.org/anthology/N18-1119/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/constrained_decoding/README.md|Data2vec_for_PyTorch/fairseq/search.py | https://www.aclweb.org/anthology/N19-1090/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_dlm/sequence_generator/multichannel_search.py|Data2vec_for_PyTorch/fairseq/search.py | https://arxiv.org/abs/1904.09751 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/search.py|Data2vec_for_PyTorch/fairseq/search.py | https://arxiv.org/abs/1611.08562 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/trainer.py | https://openreview.net/forum?id=_CMSV7FTzGI | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/trainer.py | https://openreview.net/forum?id=_CMSV7FTzGI | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wav2vec/unsupervised/w2vu_generate.py|Data2vec_for_PyTorch/fairseq_cli/hydra_train.py | https://github.com/facebookresearch/hydra/issues/1126 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wav2vec/unsupervised/w2vu_generate.py|Data2vec_for_PyTorch/fairseq_cli/hydra_validate.py | https://github.com/facebookresearch/hydra/issues/1126 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wav2vec/unsupervised/w2vu_generate.py|Data2vec_for_PyTorch/fairseq_cli/train.py | https://github.com/facebookresearch/hydra/issues/1126 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/scripts/build_sym_alignment.py|Data2vec_for_PyTorch/scripts/build_sym_alignment.py | http://github.com/clab/fast_align | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/scripts/build_sym_alignment.py|Data2vec_for_PyTorch/scripts/build_sym_alignment.py | http://github.com/moses-smt/mosesdecoder | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/scripts/build_sym_alignment.py|Data2vec_for_PyTorch/scripts/build_sym_alignment.py | http://www.statmt.org/moses/?n=Development.GetStarted | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/data/indexed_dataset.py|Data2vec_for_PyTorch/tests/test_token_block_dataset.py | https://github.com/numpy/numpy/issues/5745 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/multiprocessing_bpe_encoder.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/multiprocessing_bpe_encoder.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/roberta/preprocess_GLUE_tasks.sh|Data2vec_for_PyTorch/examples/roberta/preprocess_GLUE_tasks.sh | https://gist.github.com/W4ngatang/60c2bdb54d156a41194446737ce03e2e | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/preprocess_GLUE_tasks.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/preprocess_RACE.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/preprocess_GLUE_tasks.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/preprocess_RACE.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/preprocess_GLUE_tasks.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/dict.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/preprocess_RACE.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/dict.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/criterions/adaptive_loss.py|Data2vec_for_PyTorch/fairseq/criterions/adaptive_loss.py | http://arxiv.org/abs/1609.04309 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/criterions/speech_dlm_criterion.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/criterions/tacotron2_loss.py|Data2vec_for_PyTorch/fairseq/criterions/tacotron2_loss.py | https://arxiv.org/abs/1710.08969 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/data/indexed_dataset.py|Data2vec_for_PyTorch/fairseq/data/indexed_dataset.py | https://github.com/numpy/numpy/issues/5745 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wav2vec/README.md|Data2vec_for_PyTorch/fairseq/data/data_utils.py | https://arxiv.org/abs/1910.05453 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wav2vec/README.md|Data2vec_for_PyTorch/fairseq/data/mask_tokens_dataset.py | https://arxiv.org/abs/1910.05453 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/data/speech_dlm_dataset.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/data/span_mask_tokens_dataset.py|Data2vec_for_PyTorch/fairseq/data/span_mask_tokens_dataset.py | https://github.com/google-research/text-to-text-transfer-transformer/blob/84f8bcc14b5f2c03de51bd3587609ba8f6bbd1cd/t5/data/preprocessors.py#L2682 | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/dataclass/constants.py|Data2vec_for_PyTorch/fairseq/dataclass/constants.py | https://github.com/facebookresearch/hydra/issues/1156 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/dataclass/configs.py|Data2vec_for_PyTorch/fairseq/dataclass/configs.py | https://fairscale.readthedocs.io/en/latest/api/experimental/nn/slowmo_ddp.html | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/dataclass/utils.py|Data2vec_for_PyTorch/fairseq/dataclass/utils.py | https://github.com/omry/omegaconf/pull/911 | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/dataclass/configs.py|Data2vec_for_PyTorch/fairseq/dataclass/configs.py | https://github.com/facebookresearch/hydra/issues/1117 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/fairseq_incremental_decoder.py|Data2vec_for_PyTorch/fairseq/models/fairseq_incremental_decoder.py | http://www.telesens.co/2019/04/21/understanding-incremental-decoding-in-fairseq/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/conv_seq2seq/README.md|Data2vec_for_PyTorch/fairseq/models/fconv.py | https://arxiv.org/abs/1705.03122 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/getting_started.rst|Data2vec_for_PyTorch/fairseq/models/fconv.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt14.v2.en-fr.fconv-py.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/conv_seq2seq/README.md|Data2vec_for_PyTorch/fairseq/models/fconv.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt14.en-de.fconv-py.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/conv_seq2seq/README.md|Data2vec_for_PyTorch/fairseq/models/fconv.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt17.v2.en-de.fconv-py.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/fconv_self_att.py|Data2vec_for_PyTorch/fairseq/models/fconv_self_att.py | https://dl.fbaipublicfiles.com/fairseq/models/stories_checkpoint.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/fconv_self_att.py|Data2vec_for_PyTorch/fairseq/models/fconv_self_att.py | https://dl.fbaipublicfiles.com/fairseq/models/stories_checkpoint.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/lightconv.py|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://openreview.net/pdf?id=SkVhlh09tX | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/stories/README.md|Data2vec_for_PyTorch/fairseq/models/fconv_self_att.py | https://dl.fbaipublicfiles.com/fairseq/data/stories_test.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/iwslt14.de-en.lightconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/iwslt14.de-en.dynamicconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.lightconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.dynamicconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt14.en-fr.joined-dict.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt14.en-fr.joined-dict.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt17.zh-en.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pay_less_attention_paper/README.md|Data2vec_for_PyTorch/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt17.zh-en.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/language_model/README.adaptive_inputs.md|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/adaptive_lm_gbw_huge.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/language_model/README.adaptive_inputs.md|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/adaptive_lm_wiki103.v2.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt19.en.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt19.de.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt19.ru.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.en.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.ta.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.iu.news.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer_lm.py|Data2vec_for_PyTorch/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.iu.nh.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/criterions/adaptive_loss.py|Data2vec_for_PyTorch/fairseq/modules/adaptive_softmax.py | http://arxiv.org/abs/1609.04309 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/character_token_embedder.py|Data2vec_for_PyTorch/fairseq/modules/character_token_embedder.py | https://arxiv.org/abs/1505.00387 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_conformer.py|Data2vec_for_PyTorch/fairseq/modules/conformer_layer.py | https://arxiv.org/abs/2005.08100 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/nonautoregressive_translation/README.md|Data2vec_for_PyTorch/fairseq/modules/dynamic_crf_layer.py | https://arxiv.org/abs/1910.11555 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/dynamic_crf_layer.py|Data2vec_for_PyTorch/fairseq/modules/dynamic_crf_layer.py | https://github.com/kmkurn/pytorch-crf/blob/master/torchcrf/__init__.py | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/truncated_bptt/README.md|Data2vec_for_PyTorch/fairseq/modules/espnet_multihead_attention.py | https://arxiv.org/abs/1901.02860 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/truncated_bptt/README.md|Data2vec_for_PyTorch/fairseq/modules/espnet_multihead_attention.py | https://arxiv.org/abs/1901.02860 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/gelu.py|Data2vec_for_PyTorch/fairseq/modules/gelu.py | https://github.com/hendrycks/GELUs | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/truncated_bptt/README.md|Data2vec_for_PyTorch/fairseq/modules/espnet_multihead_attention.py | https://arxiv.org/abs/1901.02860 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/layerdrop/README.md|Data2vec_for_PyTorch/fairseq/modules/layer_drop.py | https://arxiv.org/abs/1909.11556 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/location_attention.py|Data2vec_for_PyTorch/fairseq/modules/location_attention.py | https://arxiv.org/pdf/1506.07503.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/lstm_cell_with_zoneout.py|Data2vec_for_PyTorch/fairseq/modules/lstm_cell_with_zoneout.py | https://arxiv.org/abs/1606.01305 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/truncated_bptt/README.md|Data2vec_for_PyTorch/fairseq/modules/positional_encoding.py | https://arxiv.org/abs/1901.02860 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/rotary_positional_embedding.py|Data2vec_for_PyTorch/fairseq/modules/rotary_positional_embedding.py | https://blog.eleuther.ai/rotary-embeddings/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/rotary_positional_embedding.py|Data2vec_for_PyTorch/fairseq/modules/rotary_positional_embedding.py | https://arxiv.org/pdf/2104.09864.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/sparse_multihead_attention.py|Data2vec_for_PyTorch/fairseq/modules/sparse_multihead_attention.py | https://arxiv.org/pdf/1904.10509.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/modules/vggblock.py|Data2vec_for_PyTorch/fairseq/modules/vggblock.py | https://arxiv.org/pdf/1409.1556.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adafactor.py|Data2vec_for_PyTorch/fairseq/optim/adafactor.py | https://arxiv.org/abs/1804.04235 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adam.py|Data2vec_for_PyTorch/fairseq/optim/adamax.py | https://arxiv.org/abs/1412.6980 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adam.py|Data2vec_for_PyTorch/fairseq/optim/adam.py | https://arxiv.org/abs/1711.05101 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adam.py|Data2vec_for_PyTorch/fairseq/optim/adam.py | https://arxiv.org/abs/1412.6980 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adam.py|Data2vec_for_PyTorch/fairseq/optim/adam.py | https://openreview.net/forum?id=ryQu7f-RZ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/bmuf.py|Data2vec_for_PyTorch/fairseq/optim/bmuf.py | https://ieeexplore.ieee.org/document/7472805 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adam.py|Data2vec_for_PyTorch/fairseq/optim/fused_adam.py | https://arxiv.org/abs/1412.6980 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/adam.py|Data2vec_for_PyTorch/fairseq/optim/fused_adam.py | https://openreview.net/forum?id=ryQu7f-RZ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/scaling_nmt/README.md|Data2vec_for_PyTorch/fairseq/scoring/tokenizer.py | https://github.com/mjpost/sacrebleu | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/cross_lingual_language_model/README.md|Data2vec_for_PyTorch/fairseq/tasks/cross_lingual_lm.py | https://arxiv.org/pdf/1901.07291.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/tasks/fairseq_task.py|Data2vec_for_PyTorch/fairseq/tasks/fairseq_task.py | https://arxiv.org/abs/2010.00904 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/tasks/fairseq_task.py|Data2vec_for_PyTorch/fairseq/tasks/fairseq_task.py | https://github.com/facebookresearch/GENRE | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/tasks/speech_dlm_task.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/nonautoregressive_translation/README.md|Data2vec_for_PyTorch/fairseq/tasks/translation_lev.py | https://arxiv.org/abs/1905.11006 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/tasks/translation_lev.py|Data2vec_for_PyTorch/fairseq/tasks/translation_lev.py | https://www.aclweb.org/anthology/2020.acl-main.325/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_synthesis/utils.py|Data2vec_for_PyTorch/fairseq/tasks/text_to_speech.py | https://arxiv.org/pdf/2011.03568.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/hydra_plugins/dependency_submitit_launcher/setup.py|Data2vec_for_PyTorch/hydra_plugins/dependency_submitit_launcher/setup.py | abaevski@fb.com | 开发者邮箱配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/getting_started.rst|Data2vec_for_PyTorch/tests/speech/test_convtransformer_simul_trans.py | https://dl.fbaipublicfiles.com/fairseq/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_text_joint_to_text/docs/pre-training.md|Data2vec_for_PyTorch/tests/speech/test_dual_input_wav_transformer.py | https://dl.fbaipublicfiles.com/joint_speech_text_4_s2t/acl2022/librispeech/finetuned | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/getting_started.rst|Data2vec_for_PyTorch/tests/speech/test_s2s_transformer.py | https://dl.fbaipublicfiles.com/fairseq/ | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/getting_started.rst|Data2vec_for_PyTorch/tests/speech/test_wav2vec2.py | https://dl.fbaipublicfiles.com/fairseq | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/docs/getting_started.rst|Data2vec_for_PyTorch/tests/speech/__init__.py | https://dl.fbaipublicfiles.com/fairseq | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_text_joint_to_text/docs/ende-mustc.md|Data2vec_for_PyTorch/tests/speech/__init__.py | https://dl.fbaipublicfiles.com/joint_speech_text_4_s2t/must_c/en_de | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/tests/speech_recognition/asr_test_base.py|Data2vec_for_PyTorch/tests/speech_recognition/asr_test_base.py | https://fburl.com/batch_first_example | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/tests/speech_recognition/asr_test_base.py|Data2vec_for_PyTorch/tests/speech_recognition/asr_test_base.py | https://fburl.com/batch_first_example | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/data2vec_image_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/data2vec_image_classification.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/audio_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/audio_classification.py | https://github.com/mil-tokyo/bc_learning_sound/blob/master/utils.py | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/data2vec_image_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/data2vec_text_classification.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/data2vec_image_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/data2vec_vision.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/data2vec_image_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/mae.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/data2vec_image_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/mae_image_classification.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/data2vec/models/mae_image_classification.py|Data2vec_for_PyTorch/examples/data2vec/models/mae_image_classification.py | https://github.com/microsoft/unilm/blob/master/beit/optim_factory.py#L33 | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/roberta/commonsense_qa/download_cqa_data.sh|Data2vec_for_PyTorch/examples/roberta/commonsense_qa/download_cqa_data.sh | https://s3.amazonaws.com/commensenseqa/train_rand_split.jsonl | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/roberta/commonsense_qa/download_cqa_data.sh|Data2vec_for_PyTorch/examples/roberta/commonsense_qa/download_cqa_data.sh | https://s3.amazonaws.com/commensenseqa/dev_rand_split.jsonl | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/roberta/commonsense_qa/download_cqa_data.sh|Data2vec_for_PyTorch/examples/roberta/commonsense_qa/download_cqa_data.sh | https://s3.amazonaws.com/commensenseqa/test_rand_split_no_answers.jsonl | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/examples/roberta/commonsense_qa/download_cqa_data.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/dict.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/clib/libbase/balanced_assignment.cpp|Data2vec_for_PyTorch/fairseq/clib/libbase/balanced_assignment.cpp | https://dspace.mit.edu/bitstream/handle/1721.1/3265/P-2108-26912652.pdf | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/clib/libbase/balanced_assignment.cpp|Data2vec_for_PyTorch/fairseq/clib/libbase/balanced_assignment.cpp | https://github.com/bkj/auction-lap | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/clib/libnat_cuda/binding.cpp|Data2vec_for_PyTorch/fairseq/clib/libnat_cuda/binding.cpp | https://github.com/1ytic/pytorch-edit-distance | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/data/audio/speech_to_text_dataset.py|Data2vec_for_PyTorch/fairseq/data/audio/speech_to_text_dataset.py | https://arxiv.org/abs/1907.05019 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/fairseq/data/encoders/gpt2_bpe.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/bart/README.summarization.md|Data2vec_for_PyTorch/fairseq/data/encoders/gpt2_bpe.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/data/encoders/gpt2_bpe_utils.py|Data2vec_for_PyTorch/fairseq/data/encoders/gpt2_bpe_utils.py | https://github.com/openai/gpt-2/blob/master/src/encoder.py | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/bart/hub_interface.py|Data2vec_for_PyTorch/fairseq/models/bart/hub_interface.py | https://github.com/pytorch/fairseq/tree/main/examples/bart | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/bart/model.py|Data2vec_for_PyTorch/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/bart/model.py|Data2vec_for_PyTorch/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/bart/model.py|Data2vec_for_PyTorch/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.mnli.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/bart/model.py|Data2vec_for_PyTorch/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.cnn.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/bart/model.py|Data2vec_for_PyTorch/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.xsum.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/ema/ema.py|Data2vec_for_PyTorch/fairseq/models/ema/ema.py | https://github.com/zhawe01/fairseq-gec.git | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/ema/ema.py|Data2vec_for_PyTorch/fairseq/models/ema/ema.py | https://www.tensorflow.org/api_docs/python/tf/train/ExponentialMovingAverage | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/layerdrop/README.md|Data2vec_for_PyTorch/fairseq/models/roberta/hub_interface.py | https://github.com/pytorch/fairseq/tree/main/examples/roberta | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.large.mnli.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.large.wsc.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/hub_interface.py|Data2vec_for_PyTorch/fairseq/models/roberta/hub_interface.py | https://github.com/pytorch/fairseq/issues/1306 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-ccnet.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-ccnet-4gb.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-wikipedia-4gb.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/gottbert/README.md|Data2vec_for_PyTorch/fairseq/models/roberta/model_gottbert.py | https://dl.gottbert.de/fairseq/models/gottbert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_camembert.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-oscar-4gb.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model.py|Data2vec_for_PyTorch/fairseq/models/roberta/model.py | https://openreview.net/forum?id=_CMSV7FTzGI | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_xlmr.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr.base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_xlmr.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr.large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_xlmr.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr/xlmr.xl.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/roberta/model_xlmr.py|Data2vec_for_PyTorch/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr/xlmr.xxl.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/textless_nlp/dgslm/hubert_fisher/README.md|Data2vec_for_PyTorch/fairseq/models/speech_dlm/speech_dlm.py | https://arxiv.org/pdf/2203.16502.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/convtransformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/convtransformer.py | https://arxiv.org/abs/2004.10234 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1802.04200 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://github.com/eske/seq2seq | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://github.com/eske/seq2seq/blob/master/config/LibriSpeech/AST.yaml | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://github.com/eske/seq2seq/blob/master/translate/models.py | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1409.0473 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_to_speech/docs/direct_s2st_discrete_units.md|Data2vec_for_PyTorch/fairseq/models/speech_to_speech/s2s_transformer.py | https://arxiv.org/abs/2107.05604 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_conformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/s2t_conformer.py | https://arxiv.org/abs/2005.08100 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1409.0473 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pointer_generator/pointer_generator_src/transformer_pg.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/s2t_transformer.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_transformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/s2t_transformer.py | http://dl.fbaipublicfiles.com/fairseq/s2t | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1802.04200 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_to_text/README.md|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1909.06515 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/berard.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/pdf/2002.01320.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_to_text/README.md|Data2vec_for_PyTorch/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/2006.12124 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_transformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/xm_transformer.py | http://dl.fbaipublicfiles.com/fairseq/s2t | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_transformer.py|Data2vec_for_PyTorch/fairseq/models/speech_to_text/xm_transformer_unity.py | http://dl.fbaipublicfiles.com/fairseq/s2t | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/speech_synthesis/docs/ljspeech_example.md|Data2vec_for_PyTorch/fairseq/models/text_to_speech/fastspeech2.py | https://arxiv.org/abs/2006.04558 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_transformer.py|Data2vec_for_PyTorch/fairseq/models/text_to_speech/fastspeech2.py | http://dl.fbaipublicfiles.com/fairseq/s2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/pointer_generator/pointer_generator_src/transformer_pg.py|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_base.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/text_to_speech/tacotron2.py|Data2vec_for_PyTorch/fairseq/models/text_to_speech/tacotron2.py | https://arxiv.org/pdf/1712.05884.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/text_to_speech/tts_transformer.py|Data2vec_for_PyTorch/fairseq/models/text_to_speech/tts_transformer.py | https://arxiv.org/pdf/1809.08895.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/speech_to_text/s2t_transformer.py|Data2vec_for_PyTorch/fairseq/models/text_to_speech/tts_transformer.py | http://dl.fbaipublicfiles.com/fairseq/s2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/text_to_speech/vocoder.py|Data2vec_for_PyTorch/fairseq/models/text_to_speech/vocoder.py | http://dl.fbaipublicfiles.com/fairseq/vocoder | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/scaling_nmt/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt14.en-fr.joined-dict.transformer.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/scaling_nmt/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt16.en-de.joined-dict.transformer.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/backtranslation/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt18.en-de.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/translation/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-de.joined-dict.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/translation/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-ru.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/translation/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.de-en.joined-dict.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/translation/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.ru-en.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer/transformer_legacy.py|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-de.joined-dict.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer/transformer_legacy.py|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-ru.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer/transformer_legacy.py|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.de-en.joined-dict.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/transformer/transformer_legacy.py|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.ru-en.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wmt20/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.en-ta.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wmt20/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.en-iu.news.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wmt20/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.en-iu.nh.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wmt20/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.ta-en.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wmt20/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.iu-en.news.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/wmt20/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.iu-en.nh.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/flores101/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/flores101/pretrained_models/flores101_mm100_615M.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/flores101/README.md|Data2vec_for_PyTorch/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/flores101/pretrained_models/flores101_mm100_175M.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/models/wav2vec/utils.py|Data2vec_for_PyTorch/fairseq/models/wav2vec/utils.py | https://github.com/lucidrains/local-attention/blob/master/local_attention/local_attention.py#L41 | 源码实现 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.81.1M.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.large.prenorm.81.500k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.13.125k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.30.125k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.30.195k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.60.125k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.60.265k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.75.125k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/xmod/README.md|Data2vec_for_PyTorch/fairseq/models/xmod/model.py | https://dl.fbaipublicfiles.com/fairseq/models/xmod/xmod.base.75.269k.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/megatron_11b/README.md|Data2vec_for_PyTorch/fairseq/model_parallel/modules/multihead_attention.py | https://arxiv.org/pdf/1909.08053.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/megatron_11b/README.md|Data2vec_for_PyTorch/fairseq/model_parallel/modules/transformer_layer.py | https://arxiv.org/pdf/1909.08053.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/examples/megatron_11b/README.md|Data2vec_for_PyTorch/fairseq/model_parallel/modules/transformer_layer.py | https://arxiv.org/pdf/1909.08053.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py|Data2vec_for_PyTorch/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py | https://arxiv.org/pdf/1608.03983.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py|Data2vec_for_PyTorch/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py | https://arxiv.org/pdf/1506.01186.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/facebookresearch/fairseq/blob/main/fairseq/optim/lr_scheduler/tri_stage_lr_scheduler.py|Data2vec_for_PyTorch/fairseq/optim/lr_scheduler/tri_stage_lr_scheduler.py | https://arxiv.org/pdf/1904.08779.pdf | 参考论文地址 | \ No newline at end of file diff --git a/PyTorch/built-in/nlp/Deltalm_for_PyTorch/public_address_statement.md b/PyTorch/built-in/nlp/Deltalm_for_PyTorch/public_address_statement.md new file mode 100644 index 0000000000000000000000000000000000000000..0bfc21d07f8f7ef41bb66a50cf1a65e1aa5c8113 --- /dev/null +++ b/PyTorch/built-in/nlp/Deltalm_for_PyTorch/public_address_statement.md @@ -0,0 +1,475 @@ +| 类型 | 开源代码地址 | 文件名 | 公网IP地址/公网URL地址/域名/邮箱地址 | 用途说明 | +| ---- | ------------ | ------ | ------------------------------------ | -------- | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/getting_started.rst| Deltalm_for_PyTorch/fairseq/examples/criss/unsupervised_mt/eval.sh | https://github.com/moses-smt/mosesdecoder | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/latent_depth/latent_depth_src/multilingual_translation_latent_depth.py| Deltalm_for_PyTorch/fairseq/examples/latent_depth/latent_depth_src/multilingual_translation_latent_depth.py | https://arxiv.org/pdf/2009.13102.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/tokenizers/README.md| Deltalm_for_PyTorch/fairseq/examples/m2m_100/tokenizers/tokenizer_ar.sh | http://alt.qcri.org/tools/arabic-normalizer/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/tokenizers/README.md| Deltalm_for_PyTorch/fairseq/examples/m2m_100/tokenizers/tokenizer_ar.sh | http://alt.qcri.org/tools/arabic-normalizer/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/README.md| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/binarize.py | https://github.com/google/sentencepiece | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/binarize.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/binarize.py | https://dl.fbaipublicfiles.com/fairseq/models/mbart50/sentence.bpe.model | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/binarize.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/binarize.py | https://dl.fbaipublicfiles.com/fairseq/models/mbart50/dict_250k.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_iitb.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_iitb.sh | http://www.cfilt.iitb.ac.in/~moses/iitb_en_hi_parallel/iitb_corpus_download/parallel.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-GNOME/v1/moses/en-si.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_iitb.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_iitb.sh | http://www.cfilt.iitb.ac.in/~moses/iitb_en_hi_parallel/iitb_corpus_download/dev_test.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-Ubuntu/v14.10/moses/en-si.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-KDE4/v2/moses/en-si.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-OpenSubtitles/v2018/moses/en-si.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-GNOME/v1/moses/en-ne.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-Ubuntu/v14.10/moses/en-ne.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://object.pouta.csc.fi/OPUS-KDE4/v2/moses/en-ne.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-Tatoeba/v20190709/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-wikimedia/v20190628/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_iwslt_and_extract.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-memat/v1/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-bible-uedin/v1/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-GNOME/v1/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-XhosaNavy/v1/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-KDE4/v2/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-Ubuntu/v14.10/tmx/en-xh.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_lotus.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_lotus.sh | http://lotus.kuee.kyoto-u.ac.jp/WAT/indic-multilingual/indic_languages_corpus.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/byte_level_bpe/get_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_iwslt_and_extract.sh | https://wit3.fbk.eu/archive/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-Tatoeba/v20190709/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-bible-uedin/v1/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-GNOME/v1/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | http://www.casmacat.eu/corpus/global-voices/globalvoices.ne-en.xliff.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-QED/v2.0a/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-KDE4/v2/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-OpenSubtitles/v2018/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-SPC/v1/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_af_xh.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_af_xh.sh | https://object.pouta.csc.fi/OPUS-Ubuntu/v14.10/tmx/af-en.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://github.com/christos-c/bible-corpus-tools.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://github.com/christos-c/bible-corpus/archive/v1.2.1.tar.gz | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | http://www.cle.org.pk/Downloads/ling_resources/parallelcorpus/NepaliTaggedCorpus.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://dl.fbaipublicfiles.com/fairseq/data/nepali-penn-treebank.en.patch | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://dl.fbaipublicfiles.com/fairseq/data/nepali-penn-treebank.ne.patch | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wat19_my.sh | http://lotus.kuee.kyoto-u.ac.jp/WAT/my-en-data/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wat19_my.sh | http://lotus.kuee.kyoto-u.ac.jp/WAT/my-en-data/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_flores_data.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | http://www.seas.upenn.edu/~nlp/resources/TACL-data-release/dictionaries.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/criss/download_and_preprocess_flores_test.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_flores_data.sh | https://github.com/facebookresearch/flores/raw/master/data/wikipedia_en_ne_si_test_sets.tgz | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://dl.fbaipublicfiles.com/fasttext/supervised-models/lid.176.bin | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/README.md| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/preprocess_ML50_v1.sh | https://github.com/google/sentencepiece | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://wit3.fbk.eu/archive/2017-01-trnted//texts/en/ja/en-ja.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://www.kecl.ntt.co.jp/icl/lirg/jparacrawl/release/2.0/bitext/en-ja.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/news-commentary/v15/training/news-commentary-v15.en-ja.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.ja-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.en-ja.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://nlp.stanford.edu/projects/jesc/data/split.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://www.phontron.com/kftt/download/kftt-data-1.0.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.ta-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.en-ta.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/pmindia/v1/parallel/pmindia.v1.ta-en.tsv | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://object.pouta.csc.fi/OPUS-Tanzil/v1/moses/en-ta.txt.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://preon.iiit.ac.in/~jerin/resources/datasets/pib-v0.tar | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://preon.iiit.ac.in/~jerin/resources/datasets/mkb-v0.tar | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://ufal.mff.cuni.cz/~ramasamy/parallel/data/v2/en-ta-parallel-v2.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/README.md| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_ted_and_extract.py | http://phontron.com/data/ted_talks.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://raw.githubusercontent.com/nlpc-uom/English-Tamil-Parallel-Corpus/master/En-Ta%20Corpus/En-Ta%20English.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://github.com/nlpc-uom/English-Tamil-Parallel-Corpus/raw/master/En-Ta%20Corpus/En-Ta%20Tamil.txt | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://nrc-digital-repository.canada.ca/eng/view/dataset/?id=c7e34fa7-7629-43c2-bd6d-19b32bf64f60 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.iu-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/ps-km/wmt20-sent.en-km.xz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/ps-km/km-parallel.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/ps-km/wmt20-sent.en-ps.xz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.ps-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/ps-km/ps-parallel.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://www.statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://www.statmt.org/europarl/v10/training/europarl-v10.cs-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://s3.amazonaws.com/web-language-models/paracrawl/release5.1/en-cs.txt.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/s2t_transformer.py| Deltalm_for_PyTorch/fairseq/examples/pointer_generator/pointer_generator_src/transformer_pg.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/news-commentary/v15/training/news-commentary-v15.cs-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/pointer_generator/pointer_generator_src/transformer_pg.py| Deltalm_for_PyTorch/fairseq/examples/pointer_generator/pointer_generator_src/transformer_pg.py | https://arxiv.org/abs/1704.04368 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.cs-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/rapid/RAPID_2019.cs-en.xlf.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.cs-en.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://dl.fbaipublicfiles.com/fasttext/supervised-models/lid.176.bin | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://www.statmt.org/europarl/v10/training/europarl-v10.de-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://s3.amazonaws.com/web-language-models/paracrawl/release5.1/en-de.txt.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/news-commentary/v15/training/news-commentary-v15.de-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.de-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/rapid/RAPID_2019.de-en.xlf.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.de-en.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://github.com/amake/TMX2Corpus | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://www.statmt.org/europarl/v10/training/europarl-v10.pl-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://s3.amazonaws.com/web-language-models/paracrawl/release5.1/en-pl.txt.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.pl-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://tilde-model.s3-eu-west-1.amazonaws.com/rapid2019.en-pl.tmx.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.en-pl.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufallab.ms.mff.cuni.cz/~bojar/czeng16-data/data-plaintext-format | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://s3.amazonaws.com/web-language-models/paracrawl/release1/paracrawl-release1.en-ru.zipporah0-dedup-clean.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/news-commentary/v15/training/news-commentary-v15.en-ru.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufal.mff.cuni.cz/czeng/czeng16 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.ru-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufal.mff.cuni.cz/czeng/download.php?f=convert_czeng16_to_17.pl.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-ru.tar.gz.00 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-ru.tar.gz.01 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-ru.tar.gz.02 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.en-ru.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufal.mff.cuni.cz/czeng/download.php?f=convert_czeng16_to_17.pl.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/news-commentary/v15/training/news-commentary-v15.en-zh.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wikititles/v2/wikititles-v2.zh-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt11/normalize-punctuation.perl | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-zh.tar.gz.00 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-zh.tar.gz.01 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/WikiMatrix/WikiMatrix.v1.en-zh.langid.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-un.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-nc-v8.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/test.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt20.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt20.sh | http://data.statmt.org/wmt20/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-un.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt14/training-parallel-nc-v9.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt10/training-giga-fren.tar | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt14/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt14/test-full.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://github.com/amake/tmx2corpus.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt16/translation-task/training-parallel-ep-v8.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://opus.nlpl.eu/download.php?f=SETIMES/v2/tmx/en-ro.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt16/translation-task/dev-romanian-updated.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt16/translation-task/test.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh| Deltalm_for_PyTorch/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh | https://s3.amazonaws.com/commensenseqa/train_rand_split.jsonl | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh| Deltalm_for_PyTorch/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh | https://s3.amazonaws.com/commensenseqa/dev_rand_split.jsonl | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh| Deltalm_for_PyTorch/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh | https://s3.amazonaws.com/commensenseqa/test_rand_split_no_answers.jsonl | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/bart/README.summarization.md| Deltalm_for_PyTorch/fairseq/examples/roberta/commonsense_qa/download_cqa_data.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/dict.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/CASIA2015.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/CASICT2011.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/CASICT2015.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/Datum2015.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/Datum2017.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/NEU2017.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/training-parallel-ep-v8.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/training-parallel-nc-v12.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt15/wiki-titles.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://opus.nlpl.eu/download.php?f=SETIMES/v2/tmx/en-tr.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/rapid2016.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/leta.v1.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/dcep.lv-en.v1.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/books.lv-en.v1.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-zh.tar.gz.00 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-zh.tar.gz.01 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/CASIA2015.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/CASICT2011.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/CASICT2015.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/Datum2015.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/Datum2017.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://nlp.nju.edu.cn/cwmt-wmt/NEU2017.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/test-update-1.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt17/translation-task/test.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufal.mff.cuni.cz/czeng/czeng16 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufallab.ms.mff.cuni.cz/~bojar/czeng16-data/data-plaintext-format | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt18/translation-task/training-parallel-ep-v8.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://s3.amazonaws.com/web-language-models/paracrawl/release1/paracrawl-release1.en-cs.zipporah0-dedup-clean.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://s3.amazonaws.com/web-language-models/paracrawl/release1/paracrawl-release1.en-et.zipporah0-dedup-clean.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt18/translation-task/training-parallel-nc-v13.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt18/translation-task/rapid2016.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://ufallab.ms.mff.cuni.cz/~bojar/czeng16-data/data-plaintext-format | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt18/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt18/translation-task/test.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://translate.yandex.ru/corpus?lang=en | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://translate.yandex.ru/corpus?lang=en | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/europarl/v9/training/europarl-v9.lt-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://s3.amazonaws.com/web-language-models/paracrawl/release3/en-lt.bicleaner07.tmx.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://s3.amazonaws.com/web-language-models/paracrawl/release1/paracrawl-release1.en-ru.zipporah0-dedup-clean.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://www.statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/news-commentary/v14/training/news-commentary-v14-wmt19.en-kk.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/news-commentary/v14/training/news-commentary-v14.en-ru.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wikititles/v1/wikititles-v1.kk-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wikititles/v1/wikititles-v1.ru-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wikititles/v1/wikititles-v1.kk-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wikititles/v1/wikititles-v1.lt-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wikititles/v1/wikititles-v1.gu-en.tsv.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-ru.tar.gz.00 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-ru.tar.gz.01 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-ru.tar.gz.02 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://tilde-model.s3-eu-west-1.amazonaws.com/rapid2016.en-lt.tmx.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | https://translate.yandex.ru/corpus?lang=en | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt19/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py | http://data.statmt.org/wmt19/translation-task/test.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/simultaneous_translation/models/convtransformer_simul_trans.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/models/convtransformer_simul_trans.py | https://www.aclweb.org/anthology/2020.aacl-main.58.pdf | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/simultaneous_translation/tests/test_text_models.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/tests/test_text_models.py | https://arxiv.org/pdf/1704.00784.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/utils/functions.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/functions.py | https://arxiv.org/pdf/1712.05382.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/simultaneous_translation/tests/test_text_models.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/tests/test_text_models.py | https://arxiv.org/pdf/1906.05218.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/simultaneous_translation/tests/test_text_models.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/tests/test_text_models.py | https://arxiv.org/abs/1712.05382 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/utils/latency.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/latency.py | https://arxiv.org/abs/1606.02012 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/docs/baseline.md| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/modules/monotonic_multihead_attention.py | https://www.aclweb.org/anthology/P19-1289/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/simultaneous_translation/tests/test_text_models.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/monotonic_attention.py | https://arxiv.org/pdf/1704.00784.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/utils/latency.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/latency.py | https://arxiv.org/abs/1810.08398 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/utils/latency.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/latency.py | https://arxiv.org/abs/1906.05218 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/simultaneous_translation/tests/test_text_models.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/monotonic_attention.py | https://arxiv.org/abs/1712.05382 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/utils/latency.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/monotonic_attention.py | https://arxiv.org/abs/1906.05218 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/simultaneous_translation/utils/latency.py| Deltalm_for_PyTorch/fairseq/examples/simultaneous_translation/utils/monotonic_attention.py | https://arxiv.org/abs/1906.05218 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/speech_recognition/kaldi/kaldi_decoder.py| Deltalm_for_PyTorch/fairseq/examples/speech_recognition/kaldi/kaldi_decoder.py | https://github.com/pykaldi/pykaldi | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/speech_recognition/models/vggtransformer.py| Deltalm_for_PyTorch/fairseq/examples/speech_recognition/models/vggtransformer.py | https://arxiv.org/abs/1904.11660 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/speech_text_joint_to_text/scripts/g2p_encode.py| Deltalm_for_PyTorch/fairseq/examples/speech_text_joint_to_text/scripts/g2p_encode.py | http://www.speech.cs.cmu.edu/cgi-bin/cmudict | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation_moe/README.md| Deltalm_for_PyTorch/fairseq/examples/translation_moe/translation_moe_src/logsumexp_moe.py | https://arxiv.org/abs/1902.07816 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation_moe/README.md| Deltalm_for_PyTorch/fairseq/examples/translation_moe/translation_moe_src/translation_moe.py | https://arxiv.org/abs/1902.07816 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/clib/libbase/balanced_assignment.cpp| Deltalm_for_PyTorch/fairseq/fairseq/clib/libbase/balanced_assignment.cpp | https://dspace.mit.edu/bitstream/handle/1721.1/3265/P-2108-26912652.pdf | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/clib/libbase/balanced_assignment.cpp| Deltalm_for_PyTorch/fairseq/fairseq/clib/libbase/balanced_assignment.cpp | https://github.com/bkj/auction-lap | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/clib/libnat_cuda/binding.cpp| Deltalm_for_PyTorch/fairseq/fairseq/clib/libnat_cuda/binding.cpp | https://github.com/1ytic/pytorch-edit-distance | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq_cli/hydra_train.py| Deltalm_for_PyTorch/fairseq/examples/wav2vec/unsupervised/w2vu_generate.py | https://github.com/facebookresearch/hydra/issues/1126 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/fairseq/data/encoders/gpt2_bpe.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/fairseq/data/encoders/gpt2_bpe.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe_utils.py| Deltalm_for_PyTorch/fairseq/fairseq/data/encoders/gpt2_bpe_utils.py | https://github.com/openai/gpt-2/blob/master/src/encoder.py | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/audio/speech_to_text_dataset.py| Deltalm_for_PyTorch/fairseq/fairseq/data/audio/speech_to_text_dataset.py | https://arxiv.org/abs/1907.05019 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/bart/hub_interface.py| Deltalm_for_PyTorch/fairseq/fairseq/models/bart/hub_interface.py | https://github.com/pytorch/fairseq/tree/master/examples/bart | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/bart/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/bart/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/bart/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.mnli.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/bart/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.cnn.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/bart/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/bart/model.py | http://dl.fbaipublicfiles.com/fairseq/models/bart.large.xsum.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/ema/ema.py| Deltalm_for_PyTorch/fairseq/fairseq/models/ema/ema.py | https://github.com/zhawe01/fairseq-gec.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/ema/ema.py| Deltalm_for_PyTorch/fairseq/fairseq/models/ema/ema.py | https://www.tensorflow.org/api_docs/python/tf/train/ExponentialMovingAverage | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/hub_interface.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/hub_interface.py | https://github.com/pytorch/fairseq/tree/master/examples/roberta | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.large.mnli.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model.py | http://dl.fbaipublicfiles.com/fairseq/models/roberta.large.wsc.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/hub_interface.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/hub_interface.py | https://github.com/pytorch/fairseq/issues/1306 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-ccnet.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_gottbert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_gottbert.py | https://dl.gottbert.de/fairseq/models/gottbert-base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-ccnet-4gb.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-wikipedia-4gb.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_camembert.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_camembert.py | http://dl.fbaipublicfiles.com/fairseq/models/camembert-base-oscar-4gb.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_xlmr.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr.base.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/roberta/model_xlmr.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr.large.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/roberta/model_xlmr.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr/xlmr.xl.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/roberta/model_xlmr.py| Deltalm_for_PyTorch/fairseq/fairseq/models/roberta/model_xlmr.py | http://dl.fbaipublicfiles.com/fairseq/models/xlmr/xlmr.xxl.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1802.04200 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://github.com/eske/seq2seq | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://github.com/eske/seq2seq/blob/master/config/LibriSpeech/AST.yaml | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://github.com/eske/seq2seq/blob/master/translate/models.py | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1409.0473 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/convtransformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/convtransformer.py | https://arxiv.org/abs/2004.10234 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/s2t_transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/s2t_transformer.py | https://arxiv.org/abs/1911.08460 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/s2t_transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/s2t_transformer.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1409.0473 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1802.04200 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/1909.06515 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/pdf/2002.01320.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/berard.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/berard.py | https://arxiv.org/abs/2006.12124 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/speech_to_text/s2t_transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_base.py | https://arxiv.org/abs/1706.03762 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt14.en-fr.joined-dict.transformer.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt16.en-de.joined-dict.transformer.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt18.en-de.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-de.joined-dict.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-ru.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.de-en.joined-dict.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.ru-en.ensemble.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-de.joined-dict.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.en-ru.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.de-en.joined-dict.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt19.ru-en.single_model.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.en-ta.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.en-iu.news.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.en-iu.nh.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.ta-en.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.iu-en.news.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt20.iu-en.nh.single.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/flores101/README.md| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/flores101/pretrained_models/flores101_mm100_615M.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/flores101/README.md| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer/transformer_legacy.py | https://dl.fbaipublicfiles.com/flores101/pretrained_models/flores101_mm100_175M.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/model_parallel/modules/multihead_attention.py| Deltalm_for_PyTorch/fairseq/fairseq/model_parallel/modules/multihead_attention.py | https://arxiv.org/pdf/1909.08053.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/model_parallel/modules/multihead_attention.py| Deltalm_for_PyTorch/fairseq/fairseq/model_parallel/modules/transformer_layer.py | https://arxiv.org/pdf/1909.08053.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/model_parallel/modules/multihead_attention.py| Deltalm_for_PyTorch/fairseq/fairseq/model_parallel/modules/transformer_layer.py | https://arxiv.org/pdf/1909.08053.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/lr_scheduler/cosine_lr_scheduler.py | https://arxiv.org/pdf/1608.03983.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/lr_scheduler/triangular_lr_scheduler.py | https://arxiv.org/pdf/1506.01186.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/lr_scheduler/tri_stage_lr_scheduler.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/lr_scheduler/tri_stage_lr_scheduler.py | https://arxiv.org/pdf/1904.08779.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/latent_depth/latent_depth_src/models/latent_multilingual_transformer.py| Deltalm_for_PyTorch/fairseq/examples/latent_depth/latent_depth_src/models/latent_multilingual_transformer.py | https://arxiv.org/abs/2009.13102 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/latent_depth/latent_depth_src/models/latent_multilingual_transformer.py| Deltalm_for_PyTorch/fairseq/examples/latent_depth/latent_depth_src/models/latent_transformer.py | https://arxiv.org/abs/2009.13102 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/latent_depth/latent_depth_src/models/latent_multilingual_transformer.py| Deltalm_for_PyTorch/fairseq/examples/latent_depth/latent_depth_src/modules/latent_layers.py | https://arxiv.org/abs/2009.13102 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/latent_depth/latent_depth_src/models/latent_multilingual_transformer.py| Deltalm_for_PyTorch/fairseq/examples/latent_depth/latent_depth_src/models/latent_transformer.py | https://arxiv.org/abs/2009.13102 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/speech_recognition/README.md| Deltalm_for_PyTorch/fairseq/examples/speech_recognition/new/decoders/flashlight_decoder.py | https://github.com/facebookresearch/flashlight/tree/master/bindings/python | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/wav2vec/unsupervised/README.md| Deltalm_for_PyTorch/fairseq/examples/wav2vec/unsupervised/scripts/normalize_and_filter_text.py | https://fasttext.cc/docs/en/language-identification.html | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/wav2vec/unsupervised/README.md| Deltalm_for_PyTorch/fairseq/examples/wav2vec/unsupervised/scripts/vads.py | https://github.com/zhenghuatan/rVADfast | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/audio/feature_transforms/specaugment.py| Deltalm_for_PyTorch/fairseq/fairseq/data/audio/feature_transforms/specaugment.py | https://arxiv.org/abs/1904.08779 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/speech_to_text/modules/emformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/modules/emformer.py | https://arxiv.org/abs/1803.02155 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/speech_to_text/modules/augmented_memory_attention.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/modules/augmented_memory_attention.py | https://arxiv.org/abs/2005.08042 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/speech_to_text/modules/augmented_memory_attention.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/modules/augmented_memory_attention.py | https://arxiv.org/abs/2005.09137 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/models/speech_to_text/modules/emformer.py| Deltalm_for_PyTorch/fairseq/fairseq/models/speech_to_text/modules/emformer.py | https://arxiv.org/abs/2005.09684 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py | https://github.com/keithito/tacotron | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py | https://pypi.python.org/pypi/Unidecode | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/cmudict.py | https://github.com/keithito/tacotron | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/speech_text_joint_to_text/scripts/g2p_encode.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/cmudict.py | http://www.speech.cs.cmu.edu/cgi-bin/cmudict | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/numbers.py | https://github.com/keithito/tacotron | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/stft.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/stft.py | https://github.com/pseeth/pytorch-stft | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/text.py | https://github.com/keithito/tacotron | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/textless_nlp/gslm/unit2speech/tacotron2/cleaners.py| Deltalm_for_PyTorch/fairseq/examples/textless_nlp/gslm/unit2speech/tacotron2/symbols.py | https://github.com/keithito/tacotron | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/examples/wav2vec/unsupervised/kaldi_self_train/st/cmd.sh| Deltalm_for_PyTorch/fairseq/examples/wav2vec/unsupervised/kaldi_self_train/st/cmd.sh | http://kaldi-asr.org/doc/queue.html | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/deltalm/examples/prepare_iwslt14.sh| Deltalm_for_PyTorch/examples/prepare_iwslt14.sh | https://github.com/pytorch/fairseq/blob/master/examples/translation/prepare-iwslt14.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/.gitmodules| Deltalm_for_PyTorch/fairseq/.gitmodules | https://github.com/ngoyal2707/Megatron-LM | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/setup.py| Deltalm_for_PyTorch/fairseq/setup.py | https://stackoverflow.com/a/54128391 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/setup.py| Deltalm_for_PyTorch/fairseq/setup.py | https://download.pytorch.org/whl/cpu/torch-1.7.0%2Bcpu-cp36-cp36m-linux_x86_64.whl | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/setup.py| Deltalm_for_PyTorch/fairseq/setup.py | https://bit.ly/2NLVsgE | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/.gitmodules| Deltalm_for_PyTorch/fairseq/setup.py | https://github.com/pytorch/fairseq | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/conf.py| Deltalm_for_PyTorch/fairseq/docs/conf.py | https://github.com/pytorch/fairseq/tree/master/docs/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/conf.py| Deltalm_for_PyTorch/fairseq/docs/conf.py | http://alabaster.readthedocs.io/en/latest/installation.html#sidebars | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/conf.py| Deltalm_for_PyTorch/fairseq/docs/conf.py | http://docs.scipy.org/doc/numpy/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/conf.py| Deltalm_for_PyTorch/fairseq/docs/conf.py | https://docs.python.org/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/conf.py| Deltalm_for_PyTorch/fairseq/docs/conf.py | https://pytorch.org/docs/master/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/file_utils.py| Deltalm_for_PyTorch/fairseq/fairseq/file_utils.py | https://github.com/allenai/allennlp | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/adalm/README.md| Deltalm_for_PyTorch/fairseq/fairseq/file_utils.py | https://github.com/huggingface | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/checkpoint_utils.py| Deltalm_for_PyTorch/fairseq/fairseq/checkpoint_utils.py | https://arxiv.org/abs/1909.11556 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/search.py| Deltalm_for_PyTorch/fairseq/fairseq/search.py | https://www.aclweb.org/anthology/N18-1119/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/search.py| Deltalm_for_PyTorch/fairseq/fairseq/search.py | https://www.aclweb.org/anthology/N19-1090/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/docs/make.bat| Deltalm_for_PyTorch/fairseq/docs/make.bat | http://sphinx-doc.org/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/search.py| Deltalm_for_PyTorch/fairseq/fairseq/search.py | https://arxiv.org/abs/1904.09751 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/search.py| Deltalm_for_PyTorch/fairseq/fairseq/search.py | https://arxiv.org/abs/1611.08562 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq_cli/hydra_train.py| Deltalm_for_PyTorch/fairseq/fairseq_cli/hydra_train.py | https://github.com/facebookresearch/hydra/issues/1126 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/scripts/build_sym_alignment.py| Deltalm_for_PyTorch/fairseq/scripts/build_sym_alignment.py | http://github.com/clab/fast_align | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/scripts/build_sym_alignment.py| Deltalm_for_PyTorch/fairseq/scripts/build_sym_alignment.py | http://github.com/moses-smt/mosesdecoder | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/scripts/build_sym_alignment.py| Deltalm_for_PyTorch/fairseq/scripts/build_sym_alignment.py | http://www.statmt.org/moses/?n=Development.GetStarted | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq_cli/hydra_train.py| Deltalm_for_PyTorch/fairseq/fairseq_cli/train.py | https://github.com/facebookresearch/hydra/issues/1126 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/indexed_dataset.py| Deltalm_for_PyTorch/fairseq/tests/test_token_block_dataset.py | https://github.com/numpy/numpy/issues/5745 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/adaptive_span/adaptive_span_model_wrapper.py| Deltalm_for_PyTorch/fairseq/examples/adaptive_span/adaptive_span_model_wrapper.py | https://github.com/facebookresearch/adaptive-span/blob/master/experiments/enwik8_small.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2007.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2008.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2009.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2010.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2011.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | https://github.com/facebookresearch/MIXER/blob/master/prepareData.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | https://github.com/rsennrich/subword-nmt.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | http://statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | http://statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | http://data.statmt.org/wmt18/translation-task/training-parallel-nc-v13.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | http://data.statmt.org/wmt18/translation-task/rapid2016.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | http://data.statmt.org/wmt17/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-wmt18en2de.sh | http://statmt.org/wmt14/test-full.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/tokenized_bleu.sh | https://github.com/rsennrich/subword-nmt.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2012.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt14/training-monolingual-news-crawl/news.2013.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://www.statmt.org/wmt15/training-monolingual-news-crawl-v2/news.2014.de.shuffled.v2.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://data.statmt.org/wmt16/translation-task/news.2015.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://data.statmt.org/wmt17/translation-task/news.2016.de.shuffled.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-de-monolingual.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/prepare-de-monolingual.sh | http://data.statmt.org/wmt18/translation-task/news.2017.de.shuffled.deduped.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/backtranslation/sacrebleu.sh | https://github.com/rsennrich/subword-nmt.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/byte_level_bpe/get_data.sh| Deltalm_for_PyTorch/fairseq/examples/byte_level_bpe/get_data.sh | https://wit3.fbk.eu/archive/2017-01-trnted/texts/fr/en/fr-en.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/criss/download_and_preprocess_flores_test.sh| Deltalm_for_PyTorch/fairseq/examples/criss/download_and_preprocess_flores_test.sh | https://github.com/facebookresearch/flores | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/criss/download_and_preprocess_flores_test.sh| Deltalm_for_PyTorch/fairseq/examples/criss/download_and_preprocess_flores_test.sh | https://github.com/facebookresearch/flores/raw/master/data/wikipedia_en_ne_si_test_sets.tgz | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/criss/download_and_preprocess_flores_test.sh| Deltalm_for_PyTorch/fairseq/examples/criss/download_and_preprocess_tatoeba.sh | https://github.com/facebookresearch/flores | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/criss/download_and_preprocess_tatoeba.sh| Deltalm_for_PyTorch/fairseq/examples/criss/download_and_preprocess_tatoeba.sh | https://github.com/facebookresearch/LASER | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/language_model/prepare-wikitext-103.sh | https://github.com/facebookresearch/MIXER/blob/master/prepareData.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | http://statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/language_model/prepare-wikitext-103.sh| Deltalm_for_PyTorch/fairseq/examples/language_model/prepare-wikitext-103.sh | https://s3.amazonaws.com/research.metamind.io/wikitext/wikitext-103-v1.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | http://statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | http://data.statmt.org/wmt18/translation-task/training-parallel-nc-v13.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | http://data.statmt.org/wmt18/translation-task/rapid2016.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | http://data.statmt.org/wmt17/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | http://statmt.org/wmt14/test-full.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/fast_noisy_channel/README.md| Deltalm_for_PyTorch/fairseq/examples/joint_alignment_translation/prepare-wmt18en2de_no_norm_no_escape_no_agressive.sh | https://github.com/glample/fastBPE.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | https://github.com/rsennrich/wmt16-scripts.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | https://github.com/neubig/kytea.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | https://bitbucket.org/eunjeon/mecab-ko/downloads/mecab-0.996-ko-0.9.2.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | https://bitbucket.org/eunjeon/mecab-ko-dic/downloads/mecab-ko-dic-2.1.1-20180720.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | https://github.com/anoopkunchukuttan/indic_nlp_resources.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/m2m_100/install_dependecies.sh| Deltalm_for_PyTorch/fairseq/examples/m2m_100/install_dependecies.sh | http://lotus.kuee.kyoto-u.ac.jp/WAT/my-en-data/wat2020.my-en.zip | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/examples/roberta/multiprocessing_bpe_encoder.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/examples/roberta/multiprocessing_bpe_encoder.py | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/roberta/preprocess_GLUE_tasks.sh| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_GLUE_tasks.sh | https://gist.github.com/W4ngatang/60c2bdb54d156a41194446737ce03e2e | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_GLUE_tasks.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_GLUE_tasks.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/bart/README.summarization.md| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_GLUE_tasks.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/dict.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_RACE.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/encoder.json | 模型参数相关配置 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/encoders/gpt2_bpe.py| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_RACE.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/vocab.bpe | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/bart/README.summarization.md| Deltalm_for_PyTorch/fairseq/examples/roberta/preprocess_RACE.sh | https://dl.fbaipublicfiles.com/fairseq/gpt2_bpe/dict.txt | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/speech_recognition/README.md| Deltalm_for_PyTorch/fairseq/examples/speech_recognition/w2l_decoder.py | https://github.com/facebookresearch/flashlight/tree/master/bindings/python | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/speech_to_text/prep_covost_data.py| Deltalm_for_PyTorch/fairseq/examples/speech_to_text/prep_covost_data.py | https://github.com/facebookresearch/covost | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/speech_to_text/prep_covost_data.py| Deltalm_for_PyTorch/fairseq/examples/speech_to_text/prep_covost_data.py | https://dl.fbaipublicfiles.com/covost/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-iwslt14.sh | https://github.com/facebookresearch/MIXER/blob/master/prepareData.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-iwslt14.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-iwslt14.sh | https://github.com/rsennrich/subword-nmt.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation/prepare-iwslt14.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-iwslt14.sh | http://dl.fbaipublicfiles.com/fairseq/data/iwslt14/de-en.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation/prepare-iwslt17-multilingual.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-iwslt17-multilingual.sh | https://wit3.fbk.eu/archive/2017-01-trnted/texts/de/en/de-en.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/byte_level_bpe/get_data.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-iwslt17-multilingual.sh | https://wit3.fbk.eu/archive/2017-01-trnted/texts/fr/en/fr-en.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | https://github.com/facebookresearch/MIXER/blob/master/prepareData.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | https://github.com/rsennrich/subword-nmt.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | https://github.com/facebookresearch/MIXER/blob/master/prepareData.sh | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | https://github.com/moses-smt/mosesdecoder.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | http://statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | https://github.com/rsennrich/subword-nmt.git | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | http://statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | http://data.statmt.org/wmt17/translation-task/training-parallel-nc-v12.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | http://data.statmt.org/wmt17/translation-task/dev.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | http://statmt.org/wmt14/test-full.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | http://statmt.org/wmt13/training-parallel-europarl-v7.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | http://statmt.org/wmt13/training-parallel-commoncrawl.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation/prepare-wmt14en2fr.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | http://statmt.org/wmt13/training-parallel-un.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv.py| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | https://arxiv.org/abs/1705.03122 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation/prepare-wmt14en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2de.sh | http://statmt.org/wmt14/training-parallel-nc-v9.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation/prepare-wmt14en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | http://statmt.org/wmt14/training-parallel-nc-v9.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation/prepare-wmt14en2fr.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | http://statmt.org/wmt10/training-giga-fren.tar | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/backtranslation/prepare-wmt18en2de.sh| Deltalm_for_PyTorch/fairseq/examples/translation/prepare-wmt14en2fr.sh | http://statmt.org/wmt14/test-full.tgz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/examples/translation_moe/README.md| Deltalm_for_PyTorch/fairseq/examples/translation_moe/score.py | https://arxiv.org/abs/1902.07816 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/criterions/adaptive_loss.py| Deltalm_for_PyTorch/fairseq/fairseq/criterions/adaptive_loss.py | http://arxiv.org/abs/1609.04309 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/indexed_dataset.py| Deltalm_for_PyTorch/fairseq/fairseq/data/indexed_dataset.py | https://github.com/numpy/numpy/issues/5745 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/data/mask_tokens_dataset.py| Deltalm_for_PyTorch/fairseq/fairseq/data/mask_tokens_dataset.py | https://arxiv.org/abs/1910.05453 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/dataclass/constants.py| Deltalm_for_PyTorch/fairseq/fairseq/dataclass/constants.py | https://github.com/facebookresearch/hydra/issues/1156 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/dataclass/configs.py| Deltalm_for_PyTorch/fairseq/fairseq/dataclass/configs.py | https://github.com/facebookresearch/hydra/issues/1117 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fairseq_incremental_decoder.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fairseq_incremental_decoder.py | http://www.telesens.co/2019/04/21/understanding-incremental-decoding-in-fairseq/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv.py | https://arxiv.org/abs/1705.03122 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt14.v2.en-fr.fconv-py.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt14.en-de.fconv-py.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv.py | https://dl.fbaipublicfiles.com/fairseq/models/wmt17.v2.en-de.fconv-py.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv_self_att.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv_self_att.py | https://dl.fbaipublicfiles.com/fairseq/models/stories_checkpoint.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv_self_att.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv_self_att.py | https://dl.fbaipublicfiles.com/fairseq/models/stories_checkpoint.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/fconv_self_att.py| Deltalm_for_PyTorch/fairseq/fairseq/models/fconv_self_att.py | https://dl.fbaipublicfiles.com/fairseq/data/stories_test.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://openreview.net/pdf?id=SkVhlh09tX | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/iwslt14.de-en.lightconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/iwslt14.de-en.dynamicconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.lightconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.dynamicconv.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt16.en-de.joined-dict.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt14.en-fr.joined-dict.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt14.en-fr.joined-dict.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt17.zh-en.lightconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/lightconv.py| Deltalm_for_PyTorch/fairseq/fairseq/models/lightconv.py | https://dl.fbaipublicfiles.com/fairseq/models/dynamicconv/wmt17.zh-en.dynamicconv-glu.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/adaptive_lm_gbw_huge.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/adaptive_lm_wiki103.v2.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt19.en.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/criterions/adaptive_loss.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/adaptive_softmax.py | http://arxiv.org/abs/1609.04309 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt19.de.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt19.ru.tar.bz2 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.en.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.ta.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.iu.news.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/models/transformer_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/models/transformer_lm.py | https://dl.fbaipublicfiles.com/fairseq/models/lm/wmt20.iu.nh.tar.gz | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/modules/character_token_embedder.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/character_token_embedder.py | https://arxiv.org/abs/1505.00387 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/modules/dynamic_crf_layer.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/dynamic_crf_layer.py | https://arxiv.org/abs/1910.11555 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/modules/dynamic_crf_layer.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/dynamic_crf_layer.py | https://github.com/kmkurn/pytorch-crf/blob/master/torchcrf/__init__.py | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/modules/gelu.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/gelu.py | https://github.com/hendrycks/GELUs | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/checkpoint_utils.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/layer_drop.py | https://arxiv.org/abs/1909.11556 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/modules/sparse_multihead_attention.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/sparse_multihead_attention.py | https://arxiv.org/pdf/1904.10509.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/modules/vggblock.py| Deltalm_for_PyTorch/fairseq/fairseq/modules/vggblock.py | https://arxiv.org/pdf/1409.1556.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adafactor.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/adafactor.py | https://arxiv.org/abs/1804.04235 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adam.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/adam.py | https://arxiv.org/abs/1711.05101 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adam.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/adam.py | https://arxiv.org/abs/1412.6980 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adam.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/adam.py | https://openreview.net/forum?id=ryQu7f-RZ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adam.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/adamax.py | https://arxiv.org/abs/1412.6980 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/bmuf.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/bmuf.py | https://ieeexplore.ieee.org/document/7472805 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adam.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/fused_adam.py | https://arxiv.org/abs/1412.6980 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/optim/adam.py| Deltalm_for_PyTorch/fairseq/fairseq/optim/fused_adam.py | https://openreview.net/forum?id=ryQu7f-RZ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/scoring/tokenizer.py| Deltalm_for_PyTorch/fairseq/fairseq/scoring/tokenizer.py | https://github.com/mjpost/sacrebleu | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/fairseq/tasks/cross_lingual_lm.py| Deltalm_for_PyTorch/fairseq/fairseq/tasks/cross_lingual_lm.py | https://arxiv.org/pdf/1901.07291.pdf | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/tasks/fairseq_task.py| Deltalm_for_PyTorch/fairseq/fairseq/tasks/fairseq_task.py | https://arxiv.org/abs/2010.00904 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/edgelm/fairseq/tasks/fairseq_task.py| Deltalm_for_PyTorch/fairseq/fairseq/tasks/fairseq_task.py | https://github.com/facebookresearch/GENRE | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/block_plugins/tasks/translation_lev_modified.py| Deltalm_for_PyTorch/fairseq/fairseq/tasks/translation_lev.py | https://arxiv.org/abs/1905.11006 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/GAD/block_plugins/tasks/translation_lev_modified.py| Deltalm_for_PyTorch/fairseq/fairseq/tasks/translation_lev.py | https://www.aclweb.org/anthology/2020.acl-main.325/ | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/tests/speech_recognition/asr_test_base.py| Deltalm_for_PyTorch/fairseq/tests/speech_recognition/asr_test_base.py | https://fburl.com/batch_first_example | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/decoding/IAD/fairseq/tests/speech_recognition/asr_test_base.py| Deltalm_for_PyTorch/fairseq/tests/speech_recognition/asr_test_base.py | https://fburl.com/batch_first_example | 模型相关说明 | \ No newline at end of file diff --git a/PyTorch/contrib/cv/classification/BEiT/public_address_statement.md b/PyTorch/contrib/cv/classification/BEiT/public_address_statement.md new file mode 100644 index 0000000000000000000000000000000000000000..74f034fc72defd0b3137943f975b4e022c075529 --- /dev/null +++ b/PyTorch/contrib/cv/classification/BEiT/public_address_statement.md @@ -0,0 +1,131 @@ +| 类型 | 开源代码地址 | 文件名 | 公网IP地址/公网URL地址/域名/邮箱地址 | 用途说明 | +| ---- | ------------ | ------ | ------------------------------------ | -------- | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_ms.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_ms.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_ms.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_ms.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_ms.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_ms.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_512_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_ms.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_ms.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_ms.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_ms.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_ms.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_ms.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_pt2ft.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_pt2ft.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_pt2ft.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_pt2ft.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_base_12_640_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_ms.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_ms.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_ms.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_ms.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_ms.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_ms.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_pt2ft.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_pt2ft.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_pt2ft.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_pt2ft.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_512_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_ms.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_ms.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_ms.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_ms.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_ms.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_ms.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_pt2ft.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_pt2ft.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_pt2ft.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_pt2ft.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/beit/upernet/upernet_beit_large_24_640_slide_160k_ade20k_pt2ft.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/_base_/models/upernet_beit.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/_base_/models/upernet_beit.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/configs/_base_/models/upernet_beit.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/_base_/models/upernet_beit.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/_base_/models/upernet_beit.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/configs/_base_/models/upernet_beit.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/datasets.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/datasets.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/datasets.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/datasets.py | https://github.com/facebookresearch/deit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/datasets.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/dataset_folder.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/dataset_folder.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/dataset_folder.py | BEiT/dataset_folder.py | https://github.com/pytorch/vision | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_finetuning.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_finetuning.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_finetuning.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_pretraining.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_finetuning.py | https://github.com/facebookresearch/deit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_pretraining.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_finetuning.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_pretraining.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_pretraining.py | https://github.com/facebookresearch/deit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/engine_for_pretraining.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/dataset_folder.py | BEiT/dataset_folder.py | https://github.com/python-pillow/Pillow/issues/835 | 模型相关说明 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/masking_generator.py | BEiT/masking_generator.py | https://github.com/zhunzhong07/Random-Erasing | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/masking_generator.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_discrete_vae.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/masking_generator.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_discrete_vae.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/masking_generator.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/modeling_discrete_vae.py | BEiT/modeling_discrete_vae.py | https://github.com/openai/DALL-E | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/masking_generator.py | BEiT/masking_generator.py | https://github.com/zhunzhong07/Random-Erasing | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/modeling_discrete_vae.py | BEiT/modeling_discrete_vae.py | https://github.com/lucidrains/DALLE-pytorch | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_finetune.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_finetune.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_finetune.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_finetune.py | https://github.com/facebookresearch/deit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_finetune.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_pretrain.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_pretrain.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_pretrain.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/modeling_pretrain.py | https://github.com/facebookresearch/deit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/optim_factory.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/optim_factory.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/optim_factory.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_beit_pretraining.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_beit_pretraining.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_beit_pretraining.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_beit_pretraining.py | https://github.com/facebookresearch/deit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_beit_pretraining.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning.py | https://github.com/facebookresearch/deit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning_apex_npu.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning_apex_npu.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning_apex_npu.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning_apex_npu.py | https://github.com/facebookresearch/deit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/run_class_finetuning_apex_npu.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/transforms.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/transforms.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/transforms.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/utils.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/utils.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/utils.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/utils.py | https://github.com/facebookresearch/deit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/utils.py | https://github.com/facebookresearch/dino | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/backbone/beit.py | https://arxiv.org/abs/2106.08254 | 参考论文地址 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/backbone/beit.py | https://github.com/microsoft/unilm/tree/master/beit | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/datasets.py | BEiT/semantic_segmentation/backbone/beit.py | https://github.com/rwightman/pytorch-image-models/tree/master/timm | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/backbone/beit.py | https://github.com/fudan-zvg/SETR | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/backbone/beit.py | https://github.com/facebookresearch/xcit/ | 源码实现 | +| 开源代码引入 | https://github.com/microsoft/unilm/blob/master/beit/semantic_segmentation/backbone/beit.py | BEiT/semantic_segmentation/backbone/beit.py | https://github.com/microsoft/Swin-Transformer | 源码实现 | \ No newline at end of file