Compare AI models

Specifications
ParametersThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality.
—8B/70B
Context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.
2M8k
Overview
CompanyGoogleMeta
Release dateSep 24 2024Apr 18 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Gemini 1.5 Pro-002 and LLaMA 3 (8B/70B) don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. LLaMA 3 (8B/70B) shipped 159 days before Gemini 1.5 Pro-002, so benchmark comparisons should account for the intervening progress.

Context windows are 2M (Gemini 1.5 Pro-002) vs 8k (LLaMA 3 (8B/70B)). Gemini 1.5 Pro-002 is closed, while LLaMA 3 (8B/70B) is open weight.

Direct benchmark comparisons are unavailable — Gemini 1.5 Pro-002 and LLaMA 3 (8B/70B) don't publish scores on any of the same benchmarks.