Gemini 1.0 Ultra and Code Llama don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Code Llama shipped 168 days before Gemini 1.0 Ultra, so benchmark comparisons should account for the intervening progress.

Gemini 1.0 Ultra is proprietary, while Code Llama is open weight.

Direct benchmark comparisons are unavailable — Gemini 1.0 Ultra and Code Llama don't publish scores on any of the same benchmarks.