diff --git a/.gitee/ISSUE_TEMPLATE/6-application-case.yml b/.gitee/ISSUE_TEMPLATE/6-application-case.yml index dfbf8e154b1fa9ff77b6e154895f911627c8ce97..6ea117ca91cf112235559b7e17e151e9210c1562 100644 --- a/.gitee/ISSUE_TEMPLATE/6-application-case.yml +++ b/.gitee/ISSUE_TEMPLATE/6-application-case.yml @@ -1,5 +1,5 @@ -name: 🤗 Support request for a new application case of science -description: Submit a proposal/request for a new application case of science +name: 🤗 Support request for a new application case of AIForScience +description: Submit a proposal/request for a new application case of AIForScience title: "[Application Case]: " labels: ["application-case"] diff --git a/docs/api_python/mindflow/cell/mindflow.cell.MultiHeadAttention.rst b/docs/api_python/mindflow/cell/mindflow.cell.MultiHeadAttention.rst index 4198935102cd0257fd8bef12d30421533156c1ef..5d245889df1929ca2b91d1fb11f5459be19d130b 100644 --- a/docs/api_python/mindflow/cell/mindflow.cell.MultiHeadAttention.rst +++ b/docs/api_python/mindflow/cell/mindflow.cell.MultiHeadAttention.rst @@ -10,7 +10,7 @@ mindflow.cell.MultiHeadAttention - **num_heads** (int) - 输出的输出特征维度。 - **enable_flash_attn** (bool) - 是否使能FlashAttention。FlashAttention只支持 `Ascend` 后端。具体细节参见 `FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness `_ 。 默认值: ``False`` 。 - - **fa_dtype** (mindspore.dtype): FlashAttention计算类型。支持以下类型: `mstype.bfloat16`、 `mstype.float16`。默认值: ``mstype.bfloat16`` ,表示 ``mindspore.bfloat16`` 。 + - **fa_dtype** (mindspore.dtype) - FlashAttention计算类型。支持以下类型: `mstype.bfloat16`、 `mstype.float16`。默认值: ``mstype.bfloat16`` ,表示 ``mindspore.bfloat16`` 。 - **drop_mode** (str) - dropout方式。默认值: ``dropout`` 。支持以下类型: ``dropout`` 和 ``droppath`` 。 - **dropout_rate** (float) - dropout层丢弃的比率。取值在 `[0, 1]` 。默认值: ``0.0`` 。 - **compute_dtype** (mindspore.dtype) - 网络层的数据类型。默认值: ``mstype.float32`` ,表示 ``mindspore.float32`` 。