Mathstral 7B and o1-pro don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Mathstral 7B shipped 246 days before o1-pro, so benchmark comparisons should account for the intervening progress.

Mathstral 7B is open weight, while o1-pro is proprietary.

Direct benchmark comparisons are unavailable — Mathstral 7B and o1-pro don't publish scores on any of the same benchmarks.