OpenCompass v0.1.8.rc1
Pre-release
Pre-release
Provide with more parsed datasets:
OpenCompassData-core.zip
| AGIEval | ARC | BBH | ceval | CLUE | cmmlu |
|---|---|---|---|---|---|
| commonsenseqa | drop | FewCLUE | flores_first100 | GAOKAO-BENCH | gsm8k |
| hellaswag | humaneval | lambada | LCSTS | math | mbpp |
| mmlu | nq | openbookqa | piqa | race | siqa |
| strategyqa | summedits | SuperGLUE | TheoremQA | triviaqa | tydiqa |
| winogrande | xstory_cloze | Xsum |
OpenCompassData-complete.zip
| AGIEval | anli | ARC | BBH | ceval | cleva |
|---|---|---|---|---|---|
| CLUE | CMB | cmmlu | commonsenseqa | drop | ds1000 |
| FewCLUE | flores200_dataset | flores_first100 | game24 | GAOKAO-BENCH | govrep |
| gsm8k | hellaswag | humaneval | jigsawmultilingual | lambada | lawbench |
| LCSTS | math | mbpp | mmlu | narrativeqa | nq |
| openbookqa | piqa | QASPER | race | realtoxicprompts | scibench |
| siqa | SQuAD2.0 | strategyqa | summedits | SummScreen | SuperGLUE |
| TheoremQA | triviaqa | triviaqa-rc | tydiqa | winogrande | xiezhi |
| xlsum | xstory_cloze | Xsum | FinanceIQ |