Gemini 1.0 Ultra and Code Llama 70B don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Code Llama 70B shipped 10 days before Gemini 1.0 Ultra, so benchmark comparisons should account for the intervening progress.

Gemini 1.0 Ultra is proprietary, while Code Llama 70B is open weight.

Direct benchmark comparisons are unavailable — Gemini 1.0 Ultra and Code Llama 70B don't publish scores on any of the same benchmarks.