Devstral SmallvsLlama Nemotron Ultra 253B
Devstral Small | Llama Nemotron Ultra 253B | |
|---|---|---|
| Specifications | ||
ParametersA rough measure of how big the model is. More parameters usually means more capable and more expensive to run, though it is a poor guide on its own — a smaller, newer model often beats a larger, older one. | 24B | 253B |
| BenchmarksPublished by one model only | ||
LiveCodeBenchCompetitive coding — Coding problems published so recently the AI can't have seen them in training — a contamination-free test of raw programming skill. Higher is better. | — | 66.3% |
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | — | 76% |
| Overview | ||
| Company | Mistral | NVIDIA |
| Release date | May 21 2025 | Apr 8 2025 |
| Access | Open Weight | Open Weight |
Other comparisons
Devstral SmallvsClaude Opus 5Llama Nemotron Ultra 253BvsClaude Opus 5Devstral SmallvsGPT-5.6 SolLlama Nemotron Ultra 253BvsGPT-5.6 SolDevstral SmallvsGemini 3.7 FlashLlama Nemotron Ultra 253BvsGemini 3.7 FlashDevstral SmallvsMuse GlimmerLlama Nemotron Ultra 253BvsMuse GlimmerDevstral SmallvsGrok 4.6Llama Nemotron Ultra 253BvsGrok 4.6Devstral SmallvsDeepSeek-V4-Pro-0813Llama Nemotron Ultra 253BvsDeepSeek-V4-Pro-0813
Frequently asked questions
Devstral Small and Llama Nemotron Ultra 253B don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Llama Nemotron Ultra 253B shipped 43 days before Devstral Small, so benchmark comparisons should account for the intervening progress.
Devstral Small has 24B parameters, while Llama Nemotron Ultra 253B has 253B.
Direct benchmark comparisons are unavailable — Devstral Small and Llama Nemotron Ultra 253B don't publish scores on any of the same benchmarks.
Devstral Small was released by Mistral on May 21 2025.
Llama Nemotron Ultra 253B was released by NVIDIA on Apr 8 2025.