liguodongiot--llm-action
wehub-resource-sync
266 行
3.1 KiB
Markdown
266 行
3.1 KiB
Markdown
|
|
|
|
|
|
|
|
[OpenCompass](https://github.com/open-compass/opencompass/blob/main/README_zh-CN.md)：司南 2.0 大模型评测体系。支持的数据集如下：
|
|
|
|
|
|
|
|
<table align="center">
|
|
<tbody>
|
|
<tr align="center" valign="bottom">
|
|
<td>
|
|
<b>语言</b>
|
|
</td>
|
|
<td>
|
|
<b>知识</b>
|
|
</td>
|
|
<td>
|
|
<b>推理</b>
|
|
</td>
|
|
<td>
|
|
<b>考试</b>
|
|
</td>
|
|
</tr>
|
|
<tr valign="top">
|
|
<td>
|
|
<details open>
|
|
<summary><b>字词释义</b></summary>
|
|
|
|
- WiC
|
|
- SummEdits
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>成语习语</b></summary>
|
|
|
|
- CHID
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>语义相似度</b></summary>
|
|
|
|
- AFQMC
|
|
- BUSTM
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>指代消解</b></summary>
|
|
|
|
- CLUEWSC
|
|
- WSC
|
|
- WinoGrande
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>翻译</b></summary>
|
|
|
|
- Flores
|
|
- IWSLT2017
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>多语种问答</b></summary>
|
|
|
|
- TyDi-QA
|
|
- XCOPA
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>多语种总结</b></summary>
|
|
|
|
- XLSum
|
|
|
|
</details>
|
|
</td>
|
|
<td>
|
|
<details open>
|
|
<summary><b>知识问答</b></summary>
|
|
|
|
- BoolQ
|
|
- CommonSenseQA
|
|
- NaturalQuestions
|
|
- TriviaQA
|
|
|
|
</details>
|
|
</td>
|
|
<td>
|
|
<details open>
|
|
<summary><b>文本蕴含</b></summary>
|
|
|
|
- CMNLI
|
|
- OCNLI
|
|
- OCNLI_FC
|
|
- AX-b
|
|
- AX-g
|
|
- CB
|
|
- RTE
|
|
- ANLI
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>常识推理</b></summary>
|
|
|
|
- StoryCloze
|
|
- COPA
|
|
- ReCoRD
|
|
- HellaSwag
|
|
- PIQA
|
|
- SIQA
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>数学推理</b></summary>
|
|
|
|
- MATH
|
|
- GSM8K
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>定理应用</b></summary>
|
|
|
|
- TheoremQA
|
|
- StrategyQA
|
|
- SciBench
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>综合推理</b></summary>
|
|
|
|
- BBH
|
|
|
|
</details>
|
|
</td>
|
|
<td>
|
|
<details open>
|
|
<summary><b>初中/高中/大学/职业考试</b></summary>
|
|
|
|
- C-Eval
|
|
- AGIEval
|
|
- MMLU
|
|
- GAOKAO-Bench
|
|
- CMMLU
|
|
- ARC
|
|
- Xiezhi
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>医学考试</b></summary>
|
|
|
|
- CMB
|
|
|
|
</details>
|
|
</td>
|
|
</tr>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
<tbody>
|
|
<tr align="center" valign="bottom">
|
|
<td>
|
|
<b>理解</b>
|
|
</td>
|
|
<td>
|
|
<b>长文本</b>
|
|
</td>
|
|
<td>
|
|
<b>安全</b>
|
|
</td>
|
|
<td>
|
|
<b>代码</b>
|
|
</td>
|
|
</tr>
|
|
<tr valign="top">
|
|
<td>
|
|
<details open>
|
|
<summary><b>阅读理解</b></summary>
|
|
|
|
- C3
|
|
- CMRC
|
|
- DRCD
|
|
- MultiRC
|
|
- RACE
|
|
- DROP
|
|
- OpenBookQA
|
|
- SQuAD2.0
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>内容总结</b></summary>
|
|
|
|
- CSL
|
|
- LCSTS
|
|
- XSum
|
|
- SummScreen
|
|
|
|
</details>
|
|
|
|
<details open>
|
|
<summary><b>内容分析</b></summary>
|
|
|
|
- EPRSTMT
|
|
- LAMBADA
|
|
- TNEWS
|
|
|
|
</details>
|
|
</td>
|
|
<td>
|
|
<details open>
|
|
<summary><b>长文本理解</b></summary>
|
|
|
|
- LEval
|
|
- LongBench
|
|
- GovReports
|
|
- NarrativeQA
|
|
- Qasper
|
|
|
|
</details>
|
|
</td>
|
|
<td>
|
|
<details open>
|
|
<summary><b>安全</b></summary>
|
|
|
|
- CivilComments
|
|
- CrowsPairs
|
|
- CValues
|
|
- JigsawMultilingual
|
|
- TruthfulQA
|
|
|
|
</details>
|
|
<details open>
|
|
<summary><b>健壮性</b></summary>
|
|
|
|
- AdvGLUE
|
|
|
|
</details>
|
|
</td>
|
|
<td>
|
|
<details open>
|
|
<summary><b>代码</b></summary>
|
|
|
|
- HumanEval
|
|
- HumanEvalX
|
|
- MBPP
|
|
- APPs
|
|
- DS1000
|
|
|
|
</details>
|
|
</td>
|
|
</tr>
|
|
</td>
|
|
</tr>
|
|
</tbody>
|
|
</table>
|