1 vs 0 benchmarks won
Anthropic Claude Fable 5 | Mistral Mistral Medium 3.5 | |
|---|---|---|
| Overview | ||
| Company | Anthropic | Mistral |
| Release date | Jun 9 2026 | Apr 29 2026 |
| Model type | — | — |
| Open source | No | Yes |
| Specifications | ||
Parameters | — | 128B |
Context window | — | 256k |
| Benchmarks | ||
Agentic coding SWE-Bench ProCan the AI fix real bugs in real software? It's handed actual problems from open-source projects and has to write code that genuinely solves them. Higher is better. | 80.3% | — |
Coding SWE-Bench VerifiedReal coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. | 95.5%Best | 77.6% |
Agentic terminal coding Terminal-Bench 2.1Can the AI work in a command-line terminal — running commands and finishing technical setup tasks the way a developer would? Higher is better. | 88% | — |
Agentic computer use OSWorld-VerifiedCan the AI actually operate a computer — clicking, typing, and using real apps — to finish tasks on its own? Higher is better. | 85% | — |
Knowledge work GDPval-AAMeasures how well the AI does economically valuable knowledge work, judged against human experts. Shown as a rating (like a chess Elo) — higher is better. | 1932 | — |
| Timeline | ||
| Release gap | Mistral Medium 3.5 shipped 41 days before Claude Fable 5 | |
Claude Fable 5 leads Mistral Medium 3.5 on 1 of the 1 benchmark they both report (SWE-Bench Verified). Mistral Medium 3.5 shipped 41 days before Claude Fable 5, so benchmark comparisons should account for the intervening progress.
Mistral Medium 3.5 is an open-source / open-weight model; Claude Fable 5 is proprietary.
On SWE-Bench Verified, Claude Fable 5 leads at 95.5% vs Mistral Medium 3.5 at 77.6%.