Compare AI models
| Specifications | ||
ParametersA rough measure of how big the model is. More parameters usually means more capable and more expensive to run, though it is a poor guide on its own — a smaller, newer model often beats a larger, older one. | 24B | 253B |
These models have no shared benchmark scores. | ||
LiveCodeBenchCompetitive coding — Coding problems published so recently the AI can't have seen them in training — a contamination-free test of raw programming skill. Higher is better. | — | 66.3% |
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | — | 76% |
| Overview | ||
| Company | Mistral | NVIDIA |
| Release date | May 21 2025 | Apr 8 2025 |
| Access | Open Weight | Open Weight |
| Model details | View model | View model |
Other comparisons
Devstral SmallvsClaude Haiku 5.5Llama Nemotron Ultra 253BvsClaude Haiku 5.5Devstral SmallvsGPT-6.1 SolLlama Nemotron Ultra 253BvsGPT-6.1 SolDevstral SmallvsGemini 4 ArgonLlama Nemotron Ultra 253BvsGemini 4 ArgonDevstral SmallvsMuse Spark 1.3Llama Nemotron Ultra 253BvsMuse Spark 1.3Devstral SmallvsGrok 4.7Llama Nemotron Ultra 253BvsGrok 4.7Devstral SmallvsDeepSeek-V4.1-FlashLlama Nemotron Ultra 253BvsDeepSeek-V4.1-FlashFrequently asked questions
Devstral Small and Llama Nemotron Ultra 253B don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Llama Nemotron Ultra 253B shipped 43 days before Devstral Small, so benchmark comparisons should account for the intervening progress.
Devstral Small has 24B parameters, while Llama Nemotron Ultra 253B has 253B.
Direct benchmark comparisons are unavailable — Devstral Small and Llama Nemotron Ultra 253B don't publish scores on any of the same benchmarks.