Multilingual coding
SWE-Bench Multilingual
Like SWE-Bench, but the coding problems span many programming languages, not just one. Tests how broadly the AI can code. Higher is better.
Rankings
Higher is better#189.5%
Claude Opus 5
289.1%
Claude Fable 5.1
386.6%
Claude Fable 5
484.4%
Claude Opus 4.8
581%
Qwen3.8-Flash-NextOW
680.5%
Claude Opus 4.7
779.8%
Composer 2.5
878%
Grok 4.5
977.8%
GPT-5.5
1073.7%
Composer 2
1173.3%
GLM-5
1269.3%
Qwen3.5OW
1367.72%
Nemotron 3.5 Super VLOW
1467.2%
Qwen3.6OW
1562.8%
Qwen3-Coder-NextOW
1661.3%
Devstral 2 (123B)
1757.8%
DeepSeek V3.1 Terminus
1855.7%
Devstral Small 2 (24B)
1945.78%
Nemotron 3 SuperOW
SWE-Bench Multilingual — frequently asked questions
Like SWE-Bench, but the coding problems span many programming languages, not just one. Tests how broadly the AI can code. Higher is better.