forward pass

forward pass

Share this post

forward pass
forward pass
The Open LLM Leaderboard is Closing

The Open LLM Leaderboard is Closing

“When a measure becomes a target, it ceases to be a good measure.”

Donato Riccio's avatar
Donato Riccio
Mar 20, 2025
∙ Paid
2

Share this post

forward pass
forward pass
The Open LLM Leaderboard is Closing
Share

Hugging Face's Open LLM Leaderboard is shutting down.

After being a central resource in the open-source AI community for years, the leaderboard is being retired - and probably, it's about time.

The era of benchmaxxing is over

The leaderboard gave us the era of

"7B DESTROYS GPT-4 (in one extremely specific benchmark by training on the test set)🚀🚀🔥" hyp…

Keep reading with a 7-day free trial

Subscribe to forward pass to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Donato Riccio
Privacy ∙ Terms ∙ Collection notice
Start writingGet the app
Substack is the home for great culture

Share