You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am one of the authors of the benchmark "MMLU and Winogrande human-translated into 11 African languages" added to the HELM repo about a month ago via this PR: #3237 and providing a benchmark to test LLMs on low-resource languages. However, when I was checking the leaderboard website at this link (https://crfm.stanford.edu/helm/), I noticed that our benchmark was not present. As such, I was wondering what the process was for getting added to the website (e.g. with a page like this one: https://crfm.stanford.edu/helm/cleva/latest/)? We would be glad to contribute any code, code modifications, or assets to be added; please just inform us about the steps we need to take and we can follow them promptly. Thank you very much!
Links to the benchmark information are provided below again for reference.
Hello HELM authors,
I am one of the authors of the benchmark "MMLU and Winogrande human-translated into 11 African languages" added to the HELM repo about a month ago via this PR: #3237 and providing a benchmark to test LLMs on low-resource languages. However, when I was checking the leaderboard website at this link (https://crfm.stanford.edu/helm/), I noticed that our benchmark was not present. As such, I was wondering what the process was for getting added to the website (e.g. with a page like this one: https://crfm.stanford.edu/helm/cleva/latest/)? We would be glad to contribute any code, code modifications, or assets to be added; please just inform us about the steps we need to take and we can follow them promptly. Thank you very much!
Links to the benchmark information are provided below again for reference.
Repository
https://github.com/InstituteforDiseaseModeling/Bridging-the-Gap-Low-Resource-African-Languages
Dataset
https://huggingface.co/datasets/Institute-Disease-Modeling/mmlu-winogrande-afr
Paper
https://arxiv.org/abs/2412.12417
The text was updated successfully, but these errors were encountered: