Devstral Small 2 (24B) and o1-preview don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. o1-preview shipped 453 days before Devstral Small 2 (24B), so benchmark comparisons should account for the intervening progress.

Devstral Small 2 (24B) is open weight, while o1-preview is proprietary.

Direct benchmark comparisons are unavailable — Devstral Small 2 (24B) and o1-preview don't publish scores on any of the same benchmarks.