Devstral SmallvsNemotron 3.5 Lightning
Devstral Small | Nemotron 3.5 Lightning | |
|---|---|---|
| Specifications | ||
ParametersA rough measure of how big the model is. More parameters usually means more capable and more expensive to run, though it is a poor guide on its own — a smaller, newer model often beats a larger, older one. | 24B | 30B |
Context windowHow much text the model can hold in mind at once — your question, any documents you attach, the conversation so far, and its own reply. Go past it and the earliest part falls out of view. | — | 1M |
| BenchmarksPublished by one model only | ||
SWE-Bench VerifiedCoding — Real coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. | — | 51.6% |
GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better. | — | 75.4% |
| Overview | ||
| Company | Mistral | NVIDIA |
| Release date | May 21 2025 | Aug 11 2026 |
| Access | Open Weight | Open Source |
Other comparisons
Frequently asked questions
Devstral Small and Nemotron 3.5 Lightning don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Devstral Small shipped 447 days before Nemotron 3.5 Lightning, so benchmark comparisons should account for the intervening progress.
Devstral Small has 24B parameters, while Nemotron 3.5 Lightning has 30B. Devstral Small is open weight, while Nemotron 3.5 Lightning is open source.
Direct benchmark comparisons are unavailable — Devstral Small and Nemotron 3.5 Lightning don't publish scores on any of the same benchmarks.
Devstral Small was released by Mistral on May 21 2025.
Nemotron 3.5 Lightning was released by NVIDIA on Aug 11 2026.
Devstral Small is an open weight model released by Mistral. Nemotron 3.5 Lightning is an open source model released by NVIDIA.