Compare AI models
| Specifications | ||
ParametersThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. | — | 4B |
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider. | 128k | 256k |
| Benchmarks | ||
SWE-Bench VerifiedCoding — Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. | 61.6% | 59.5% |
Terminal-Bench 2.1Agentic terminal coding — Can the AI work in a command-line terminal — running commands and finishing technical setup tasks the way a developer would? Higher is better. | — | 18.1% |
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | — | 72.41% |
IFBenchInstruction following — Tests whether the AI can follow detailed instructions and satisfy multiple constraints at once. Higher is better. | — | 77.94% |
| Overview | ||
| Company | Mistral | NVIDIA |
| Release date | Jul 10 2025 | Oct 16 2026 |
| Access | Closed | Open Weight |
| Model details | View model | View model |
Other comparisons
Devstral MediumvsClaude Fable 5.2Nemotron Labs Dory 1.0 4BvsClaude Fable 5.2Devstral MediumvsGPT-6.2 AstraNemotron Labs Dory 1.0 4BvsGPT-6.2 AstraDevstral MediumvsGemini 4 HydrogenNemotron Labs Dory 1.0 4BvsGemini 4 HydrogenDevstral MediumvsMuse EmberNemotron Labs Dory 1.0 4BvsMuse EmberDevstral MediumvsGrok 4.7Nemotron Labs Dory 1.0 4BvsGrok 4.7Devstral MediumvsDeepSeek-V4.1-Flash-1017Nemotron Labs Dory 1.0 4BvsDeepSeek-V4.1-Flash-1017Frequently asked questions
Devstral Medium leads Nemotron Labs Dory 1.0 4B on 1 of the 1 benchmark they both report (SWE-Bench Verified). Devstral Medium shipped 463 days before Nemotron Labs Dory 1.0 4B, so benchmark comparisons should account for the intervening progress.
Context windows are 128k (Devstral Medium) vs 256k (Nemotron Labs Dory 1.0 4B). Devstral Medium is closed, while Nemotron Labs Dory 1.0 4B is open weight.
On SWE-Bench Verified, Devstral Medium leads at 61.6% vs Nemotron Labs Dory 1.0 4B at 59.5%.