Gemma 2 and o1-mini don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Gemma 2 shipped 77 days before o1-mini, so benchmark comparisons should account for the intervening progress.

Gemma 2 is open weight, while o1-mini is proprietary.

Direct benchmark comparisons are unavailable — Gemma 2 and o1-mini don't publish scores on any of the same benchmarks.