Devstral Small vs o3
Mistral Devstral Small | OpenAI o3 | |
|---|---|---|
| Overview | ||
| Company | Mistral | OpenAI |
| Release date | May 21 2025 | Apr 16 2025 |
| Access | Open Weight | Proprietary |
| Specifications | ||
Parameters | 24B | — |
| Benchmarks | ||
Nonsense detection BullshitBench v2Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better. | — | 26% |
| Timeline | ||
| Release gap | o3 shipped 35 days before Devstral Small | |
Which is better: Devstral Small or o3?
Devstral Small and o3 don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. o3 shipped 35 days before Devstral Small, so benchmark comparisons should account for the intervening progress.
Devstral Small is open weight, while o3 is proprietary.
Direct benchmark comparisons are unavailable — Devstral Small and o3 don't publish scores on any of the same benchmarks.
Frequently asked questions
Devstral Small was released by Mistral on May 21 2025.
o3 was released by OpenAI on Apr 16 2025.
Devstral Small is an open weight model released by Mistral. o3 is a proprietary model released by OpenAI.