Compare AI models
| Specifications | ||
ParametersThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. | — | 253B |
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider. | 128k | 128k |
| These models have no shared benchmark scores. | ||
SWE-Bench VerifiedCoding — Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. | 61.6% | — |
LiveCodeBenchCompetitive coding — Coding problems published so recently the AI can't have seen them in training — a contamination-free test of raw programming skill. Higher is better. | — | 66.3% |
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | — | 76% |
| Overview | ||
| Company | Mistral | NVIDIA |
| Release date | Jul 10 2025 | Apr 7 2025 |
| Access | Closed | Open Weight |
| Model details | View model | View model |
Other comparisons
Devstral MediumvsClaude Fable 5.2Llama Nemotron Ultra 253BvsClaude Fable 5.2Devstral MediumvsGPT-6.2 AstraLlama Nemotron Ultra 253BvsGPT-6.2 AstraDevstral MediumvsGemini 4 HydrogenLlama Nemotron Ultra 253BvsGemini 4 HydrogenDevstral MediumvsMuse EmberLlama Nemotron Ultra 253BvsMuse EmberDevstral MediumvsGrok 4.7Llama Nemotron Ultra 253BvsGrok 4.7Devstral MediumvsDeepSeek-V4.1-Flash-1017Llama Nemotron Ultra 253BvsDeepSeek-V4.1-Flash-1017Frequently asked questions
Devstral Medium and Llama Nemotron Ultra 253B don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Llama Nemotron Ultra 253B shipped 94 days before Devstral Medium, so benchmark comparisons should account for the intervening progress.
Context windows are 128k (Devstral Medium) vs 128k (Llama Nemotron Ultra 253B). Devstral Medium is closed, while Llama Nemotron Ultra 253B is open weight.
Direct benchmark comparisons are unavailable — Devstral Medium and Llama Nemotron Ultra 253B don't publish scores on any of the same benchmarks.