Live Leaderboard for Parameter Golf

[stpcoder]

Built a live unofficial leaderboard for Parameter Golf that auto-updates every 30 minutes.
You can check rankings, scores, and linked PRs/records here.
If there’s a feature you’d want, leave a comment.

https://parameter-golf.github.io/

[jordankzf]

can we filter out val-only submissions?

[stpcoder]

Added that in. Val-only filter so you can quickly surface PRs that were implemented as val-only.
Thanks for the suggestion.

[ayushnangia]

no he is saying to remove val only

[stpcoder]

Oh I see. Updated Val-only is excluded by default.

[signalrush]

@stpcoder Some submission are recorded wrong in the merge only col. For example the current 9th Int5 MLP + Bigram (10240) should instead have score 1.1428

[stpcoder]

@signalrush Thanks for flagging this. I checked the latest deployed data and the source submission.json for that entry has val_loss = 1.14276 but no val_bpb field, so I think the score is missing from the submitted data rather than being changed by the leaderboard.

[sahiee-dev]

@stpcoder Would it be possible to exclude closed PRs from the leaderboard as a filter option? They're no longer competitive submissions so they add noise when trying to see the real standings.

thanks!!