Abstract reasoning

ARC-AGI-2

Puzzle-style tests of abstract reasoning and pattern-finding — the kind of thing people find easy but AIs often struggle with. Higher is better.

Rankings

Higher is better
#1
GPT-6 Astra
via BenchLM
95%
2
GPT-6.1 Sol
via BenchLM
94.17%
3
GPT-5.6 Sol
via BenchLM
92.5%
4
Claude Opus 5.5
via BenchLM
91.7%
5
Gemini 4 Argon
via BenchLM
91.25%
6
Claude Opus 5
via BenchLM
90.4%
7
Claude Fable 5.1
90%
8
GPT-6 Sol
via BenchLM
89.58%
9
Claude Fable 5
via BenchLM
89.2%
9
Gemini 3.8 Flash
via BenchLM
89.2%
11
GPT-5.5
84.6%
11
Gemini 3.7 Flash
via BenchLM
84.6%
13
GPT-5.5-Pro
via BenchLM
84.2%
14
GPT-5.6 Terra
via BenchLM
83.9%
15
GPT-5.4-Pro
via BenchLM
83.3%
16
Gemini 3.1 Pro
77.1%
17
Claude Opus 4.7
75.8%
18
GPT-5.4
via BenchLM
73.95%
19
Gemini 3.5 Flash
72.1%
20
Claude Opus 4.8
via BenchLM
72.08%
21
Claude Opus 4.6
via BenchLM
68.75%
22
Grok 4.6
via BenchLM
67.1%
23
DeepSeek-V4-Flash-0731OW
via BenchLM
61.4%
24
Grok 4.7
via BenchLM
61.39%
25
DeepSeek-V4-Pro-0813OW
via BenchLM
61.3%
26
Claude Haiku 5.5
via BenchLM
61.25%
27
Kimi K3
via BenchLM
60.4%
27
Gemini 3.6 Flash
via BenchLM
60.4%
29
GPT-5.6 Luna
via BenchLM
59.54%
30
GPT-6 Luna
via BenchLM
59.3%
31
Claude Sonnet 4.6
58.3%
32
Grok 4.20 Beta
via BenchLM
53.3%
33
GPT-5.2
via BenchLM
52.9%
34
Grok 4.5
via BenchLM
52.64%
35
Muse Spark
via BenchLM
42.5%
36
Claude Opus 4.5
via BenchLM
37.64%
37
Gemini 3.0 Flash
33.6%
38
Gemini 3.0 Pro
via BenchLM
31.1%
39
GPT-5.4 mini
via BenchLM
18.9%
40
Claude Sonnet 4.5
via BenchLM
13.6%
41
GPT-5.4 nano
via BenchLM
5.7%

Scores marked “via” above are quoted with attribution from BenchLM, retrieved 22 October 2026.

ARC-AGI-2 — frequently asked questions

Puzzle-style tests of abstract reasoning and pattern-finding — the kind of thing people find easy but AIs often struggle with. Higher is better.