Abstract reasoning
ARC-AGI-2
Puzzle-style tests of abstract reasoning and pattern-finding — the kind of thing people find easy but AIs often struggle with. Higher is better.
Rankings
Higher is better#195%
GPT-6 Astravia BenchLM
via BenchLM
292.5%
GPT-5.6 Solvia BenchLM
via BenchLM
391.7%
Claude Opus 5.5via BenchLM
via BenchLM
490.4%
Claude Opus 5via BenchLM
via BenchLM
590%
Claude Fable 5.1
689.2%
Claude Fable 5via BenchLM
via BenchLM
689.2%
Gemini 3.8 Flashvia BenchLM
via BenchLM
884.6%
GPT-5.5
884.6%
Gemini 3.7 Flashvia BenchLM
via BenchLM
1084.2%
GPT-5.5-Provia BenchLM
via BenchLM
1183.9%
GPT-5.6 Terravia BenchLM
via BenchLM
1283.3%
GPT-5.4-Provia BenchLM
via BenchLM
1377.1%
Gemini 3.1 Pro
1475.8%
Claude Opus 4.7
1573.95%
GPT-5.4via BenchLM
via BenchLM
1672.1%
Gemini 3.5 Flash
1772.08%
Claude Opus 4.8via BenchLM
via BenchLM
1867.1%
Grok 4.6via BenchLM
via BenchLM
1961.4%
DeepSeek-V4-Flash-0731OWvia BenchLM
via BenchLM
2061.3%
DeepSeek-V4-Pro-0813OWvia BenchLM
via BenchLM
2160.4%
Kimi K3via BenchLM
via BenchLM
2160.4%
Gemini 3.6 Flashvia BenchLM
via BenchLM
2359.54%
GPT-5.6 Lunavia BenchLM
via BenchLM
2459.3%
GPT-6 Lunavia BenchLM
via BenchLM
2558.3%
Claude Sonnet 4.6
2653.3%
Grok 4.20 Betavia BenchLM
via BenchLM
2752.9%
GPT-5.2via BenchLM
via BenchLM
2852.64%
Grok 4.5via BenchLM
via BenchLM
2942.5%
Muse Sparkvia BenchLM
via BenchLM
3033.6%
Gemini 3.0 Flash
3131.1%
Gemini 3.0 Provia BenchLM
via BenchLM
3218.9%
GPT-5.4 minivia BenchLM
via BenchLM
3313.6%
Claude Sonnet 4.5via BenchLM
via BenchLM
345.7%
GPT-5.4 nanovia BenchLM
via BenchLM
Scores marked “via” above are quoted with attribution from BenchLM, retrieved 28 September 2026.
ARC-AGI-2 — frequently asked questions
Puzzle-style tests of abstract reasoning and pattern-finding — the kind of thing people find easy but AIs often struggle with. Higher is better.