Code Llama and o3-pro don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Code Llama shipped 656 days before o3-pro, so benchmark comparisons should account for the intervening progress.

Code Llama is open weight, while o3-pro is proprietary.

Direct benchmark comparisons are unavailable — Code Llama and o3-pro don't publish scores on any of the same benchmarks.