Devstral Small vs Grok 4.5
Mistral Devstral Small | SpaceXAI Grok 4.5 | |
|---|---|---|
| Overview | ||
| Company | Mistral | SpaceXAI |
| Release date | May 21 2025 | Jul 8 2026 |
| Access | Open Weight | Proprietary |
| Specifications | ||
Parameters | 24B | — |
| Benchmarks | ||
Agentic coding SWE-Bench ProCan the AI fix real bugs in real software? It's handed actual problems from open-source projects and has to write code that genuinely solves them. Higher is better. | — | 64.7% |
Multilingual coding SWE-Bench MultilingualLike SWE-Bench, but the coding problems span many programming languages, not just one. Tests how broadly the AI can code. Higher is better. | — | 78% |
Agentic coding DeepSWE 1.0Artificial Analysis' independent test of deep, agentic software-engineering work — the AI has to plan and carry out substantial coding tasks end to end. Higher is better. | — | 62% |
Next.js coding Next.js EvalsVercel's open eval of how well AI coding agents build and migrate real Next.js apps — measured as the share of tasks the agent completes successfully. Higher is better. | — | 83% |
Agentic terminal coding Terminal-Bench 2.1Can the AI work in a command-line terminal — running commands and finishing technical setup tasks the way a developer would? Higher is better. | — | 83.3% |
Agentic legal work Harvey's Legal Agent BenchmarkHarvey's test of whether an AI agent can complete real legal work — drafting and reviewing documents, working with spreadsheets and presentations, and navigating files the way a lawyer's assistant would. Higher is better. | — | 12.92% |
Medical admin work MedScribeCan the AI support doctors with their administrative work, like notes and paperwork? Created by Vals AI. Higher is better. | — | 86.88% |
Community preference (code) Arena Elo (Code)Like the text arena, but people vote on which AI writes better code. The votes become a chess-style Elo rating on arena.ai. Higher is better. | — | 1566 |
| Timeline | ||
| Release gap | Devstral Small shipped 413 days before Grok 4.5 | |
Which is better: Devstral Small or Grok 4.5?
Devstral Small and Grok 4.5 don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Devstral Small shipped 413 days before Grok 4.5, so benchmark comparisons should account for the intervening progress.
Devstral Small is open weight, while Grok 4.5 is proprietary.
Direct benchmark comparisons are unavailable — Devstral Small and Grok 4.5 don't publish scores on any of the same benchmarks.
Frequently asked questions
Devstral Small was released by Mistral on May 21 2025.
Grok 4.5 was released by SpaceXAI on Jul 8 2026.
Devstral Small is an open weight model released by Mistral. Grok 4.5 is a proprietary model released by SpaceXAI.
Other comparisons
Devstral Small vs Claude Sonnet 5Grok 4.5 vs Claude Sonnet 5Devstral Small vs GPT-5.6 SolGrok 4.5 vs GPT-5.6 SolDevstral Small vs Gemini OmniGrok 4.5 vs Gemini OmniDevstral Small vs Muse Spark 1.1Grok 4.5 vs Muse Spark 1.1Devstral Small vs DeepSeek-V4-ProGrok 4.5 vs DeepSeek-V4-ProDevstral Small vs Kimi K2.7 CodeGrok 4.5 vs Kimi K2.7 Code