AI Model Release Tracker
Coding

SWE-Bench Verified

Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better.

Rankings

Higher is better
#1
Claude Opus 5via BenchLM
96%
2
Claude Fable 5
95.5%
2
Claude Mythos 5via BenchLM
95.5%
4
Claude Opus 4.8via BenchLM
88.6%
5
Claude Opus 4.7via BenchLM
87.6%
6
Claude Sonnet 5via BenchLM
85.2%
7
GPT-5.3-Codexvia BenchLM
85%
8
Claude Opus 4.5via BenchLM
80.9%
9
Claude Opus 4.6
80.8%
10
Gemini 3.1 Pro
80.6%
10
DeepSeek-V4-Pro-0813via BenchLM
80.6%
12
Qwen3.7-Maxvia BenchLM
80.4%
13
Kimi K2.6
80.2%
14
GPT-5.2
80%
15
Claude Sonnet 4.6
79.6%
16
DeepSeek-V4-Flash-0731via BenchLM
79%
17
Qwen3.6-Plusvia BenchLM
78.8%
18
Gemini 3.0 Flash
78%
19
GLM-5
77.8%
20
Qwen3.7-Plusvia BenchLM
77.7%
21
Mistral Medium 3.5
77.6%
22
Muse Spark
77.4%
23
Claude Sonnet 4.5
77.2%
24
Kimi K2.5
76.8%
25
Grok 4.20 Betavia BenchLM
76.7%
26
Qwen3.5OW
76.4%
27
GPT-5.1
76.3%
28
Gemini 3.0 Pro
76.2%
29
Muse GlimmerOW
76%
30
Claude Opus 4.1
74.5%
31
GLM-4.7
73.8%
32
Qwen3.6OW
73.4%
33
Claude Haiku 4.5
73.3%
34
Claude Sonnet 4
72.7%
35
Claude Opus 4
72.5%
36
Nemotron 3 UltraOSvia BenchLM
71.9%
37
Kimi K2 Thinking
71.3%
38
Grok Code Fast 1via BenchLM
70.8%
39
Qwen3-Coder-NextOW
70.6%
40
GLM-4.6
68%
41
Kimi K2
65.8%
41
Kimi K2 (0905)
65.8%
43
GLM-4.5
64.2%
44
gpt-oss-120bOW
62.4%
45
Claude 3.7 Sonnet
62.3%
46
gpt-oss-20bOW
60.7%
47
Nemotron 3 SuperOS
60.5%
48
GLM-4.5-Air
59.8%
49
Gemini 2.5 Pro
59.6%
50
GPT-4.1via BenchLM
54.6%
51
Nemotron 3.5 LightningOS
51.6%
52
o3-minivia BenchLM
49.3%
53
Claude 3.5 Sonnet (upgraded)
49%
54
Claude 3.5 Haiku
40.6%
55
Claude 3.5 Sonnet
33.4%
56
Claude 3 Opus
33%
57
GPT-4.1 minivia BenchLM
23.6%

Scores marked “via” above are quoted with attribution from BenchLM, retrieved 31 August 2026.

SWE-Bench Verified — frequently asked questions

Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better.