LLM Leaderboard
The Story
A compact comparison of how language models solve Redactle under distinct evaluation configurations.
New Game Settings Info News How to Play Stats More games Support R E DACTLE New Game Settings News How to Play Stats More games Support R E DACTLE Sign in Can an LLM solve a Redactle? Redactle is a puzzle game where a redacted Wikipedia article is displayed. Guessing a word reveals all matches in the article, including variations like 1 and one. Once the entire title is revealed, the game is won.
One day I was pasting Redactle text into LLM chats from different providers and got wildly different results. I got nerd sniped and built a leaderboard to fairly evaluate as many as I could. $26.83 later, I now have this dashboard to answer that question.
The results are surprising. Reasoning effort did not help as much as I expected. Gemini and Grok are the best, not OpenAI and Anthropic models as I had expected. Gemini 3.7 Flash does exceedingly well, managing to snipe all 12 puzzles while being the cheapest and fastest.
Overview
A compact comparison of how language models solve Redactle under distinct evaluation configurations.
A compact comparison of how language models solve Redactle under distinct evaluation configurations.
New Game Settings Info News How to Play Stats More games Support R E DACTLE New Game Settings News How to Play Stats More games Support R E DACTLE Sign in Can an LLM solve a Redactle? Redactle is a puzzle game where a redacted Wikipedia article is displayed. Guessing a word reveals all matches in the article, including variations like 1 and one. Once the entire title is revealed, the game is won.
One day I was pasting Redactle text into LLM chats from different providers and got wildly different results. I got nerd sniped and built a leaderboard to fairly evaluate as many as I could. $26.83 later, I now have this dashboard to answer that question.
The results are surprising. Reasoning effort did not help as much as I expected. Gemini and Grok are the best, not OpenAI and Anthropic models as I had expected. Gemini 3.7 Flash does exceedingly well, managing to snipe all 12 puzzles while being the cheapest and fastest.
FAQ
What is LLM Leaderboard?
A compact comparison of how language models solve Redactle under distinct evaluation configurations.
Where can I access LLM Leaderboard?
Use the official product link below. It is the destination recorded for this listing.
Where should I check current pricing and availability?
Check the current product page before making a decision. The directory's pricing category is a listing field, not a live price quote or availability guarantee.
What stack is LLM Leaderboard built with?
The CompassPad entry does not list a specific stack for LLM Leaderboard.
Is LLM Leaderboard free, or does it cost money?
The CompassPad listing records LLM Leaderboard as paid. Check the product page for current pricing.
What we checked
- DISCOVEREDFound in the wild
This listing was discovered from a public launch post and the description above is drawn from the product's own website.
- LIVEProduct site
The product site resolved when this entry was added to the catalog.
Discussion
No comments yet. Be the first.
Join the conversation. Sign up to comment.
Sign up free