Abstract reasoning
ARC-AGI-2
Puzzle-style tests of abstract reasoning and pattern-finding — the kind of thing people find easy but AIs often struggle with. Higher is better.
Rankings
Higher is better#195%
GPT-6 Astravia BenchLM
via BenchLM
294.17%
GPT-6.1 Solvia BenchLM
via BenchLM
392.5%
GPT-5.6 Solvia BenchLM
via BenchLM
491.7%
Claude Opus 5.5via BenchLM
via BenchLM
591.25%
Gemini 4 Argonvia BenchLM
via BenchLM
690.4%
Claude Opus 5via BenchLM
via BenchLM
790%
Claude Fable 5.1
889.58%
GPT-6 Solvia BenchLM
via BenchLM
989.2%
Claude Fable 5via BenchLM
via BenchLM
989.2%
Gemini 3.8 Flashvia BenchLM
via BenchLM
1184.6%
GPT-5.5
1184.6%
Gemini 3.7 Flashvia BenchLM
via BenchLM
1384.2%
GPT-5.5-Provia BenchLM
via BenchLM
1483.9%
GPT-5.6 Terravia BenchLM
via BenchLM
1583.3%
GPT-5.4-Provia BenchLM
via BenchLM
1677.1%
Gemini 3.1 Pro
1775.8%
Claude Opus 4.7
1873.95%
GPT-5.4via BenchLM
via BenchLM
1972.1%
Gemini 3.5 Flash
2072.08%
Claude Opus 4.8via BenchLM
via BenchLM
2168.75%
Claude Opus 4.6via BenchLM
via BenchLM
2267.1%
Grok 4.6via BenchLM
via BenchLM
2361.4%
DeepSeek-V4-Flash-0731OWvia BenchLM
via BenchLM
2461.39%
Grok 4.7via BenchLM
via BenchLM
2561.3%
DeepSeek-V4-Pro-0813OWvia BenchLM
via BenchLM
2661.25%
Claude Haiku 5.5via BenchLM
via BenchLM
2760.4%
Kimi K3via BenchLM
via BenchLM
2760.4%
Gemini 3.6 Flashvia BenchLM
via BenchLM
2959.54%
GPT-5.6 Lunavia BenchLM
via BenchLM
3059.3%
GPT-6 Lunavia BenchLM
via BenchLM
3158.3%
Claude Sonnet 4.6
3253.3%
Grok 4.20 Betavia BenchLM
via BenchLM
3352.9%
GPT-5.2via BenchLM
via BenchLM
3452.64%
Grok 4.5via BenchLM
via BenchLM
3542.5%
Muse Sparkvia BenchLM
via BenchLM
3637.64%
Claude Opus 4.5via BenchLM
via BenchLM
3733.6%
Gemini 3.0 Flash
3831.1%
Gemini 3.0 Provia BenchLM
via BenchLM
3918.9%
GPT-5.4 minivia BenchLM
via BenchLM
4013.6%
Claude Sonnet 4.5via BenchLM
via BenchLM
415.7%
GPT-5.4 nanovia BenchLM
via BenchLM
Scores marked “via” above are quoted with attribution from BenchLM, retrieved 22 October 2026.
ARC-AGI-2 — frequently asked questions
Puzzle-style tests of abstract reasoning and pattern-finding — the kind of thing people find easy but AIs often struggle with. Higher is better.