Compare AI models

Specifications
Parameters
70B8B/43B
Context window
16k4k
These models have no shared benchmark scores.
Overview
CompanyMetaNVIDIA
Release dateJan 29 2024Mar 21 2023
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

Code Llama 70B and NeMo GPT (8B/43B) don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. NeMo GPT (8B/43B) shipped 314 days before Code Llama 70B, so benchmark comparisons should account for the intervening progress.

Code Llama 70B has 70B parameters, while NeMo GPT (8B/43B) has 8B/43B. Context windows are 16k (Code Llama 70B) vs 4k (NeMo GPT (8B/43B)). Code Llama 70B is open weight, while NeMo GPT (8B/43B) is closed.

Direct benchmark comparisons are unavailable — Code Llama 70B and NeMo GPT (8B/43B) don't publish scores on any of the same benchmarks.