This repository was archived by the owner on Apr 1, 2025. It is now read-only.
Geekbench crowdsources CPU performance matrix. Should SCER explore similar crowdsourcing approach to LLMs carbon footprint/efficiencies? #56
Assignees
Labels
question
Further information is requested
Comments
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Geekbench: https://browser.geekbench.com/v6/cpu/singlecore
Huggingface: It appears that huggingface is doing evaluations of LLMs in their backend in the form of leaderboard. Is it possible to democratize that? Are there ways for huggingface or the open source community to make the LLMs evaluation process more transparent and make the results more easily reproducible?
The text was updated successfully, but these errors were encountered: