LLaMA 3 (8B/70B)Open Weight
Released
LLaMA 3 (8B/70B) is an AI model released by Meta on Thursday, Apr 18 2024, 80 days after Code Llama 70B. It is an open-weight model — the trained weights are available to download and run. It was released in 8B and 70B parameter sizesThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality., with a 8k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.. Benchmark results (shown below) cover HumanEval, MATH, MMLU, and GSM8K.
Get Meta releases and AI news.
Every other Monday
Benchmarks
Coding
Reasoning & science
Compare LLaMA 3 (8B/70B) with
Suggested comparisons
LLaMA 3 (8B/70B)vsMuse EmberLLaMA 3 (8B/70B)vsGPT-6.2 AstraLLaMA 3 (8B/70B)vsClaude Fable 5.2LLaMA 3 (8B/70B)vsGemini 4 HydrogenLLaMA 3 (8B/70B)vsGrok 4.7LLaMA 3 (8B/70B)vsDeepSeek-V4.1-Flash-1017LLaMA 3 (8B/70B)vsMistral Large 4LLaMA 3 (8B/70B)vsKimi K3.1 ProLLaMA 3 (8B/70B)vsGLM-5.3-FlashLLaMA 3 (8B/70B)vsQwen4-MaxLLaMA 3 (8B/70B)vsNemotron 3.5 Bolt E4B 4GBAbout
Llama 3 launched on April 18, 2024 with 8B and 70B parameter models, each offered as pretrained and instruction-tuned checkpoints. Meta emphasized improvements in following instructions, coding, reasoning and reducing unnecessary refusals. The first release was text based, and its 8,192-token context window was separate from the much longer context introduced with Llama 3.1 later that year. The publisher benchmarks listed here use the 70B Instruct checkpoint.
Meta reported pretraining on more than 15 trillion tokens and introduced a larger tokenizer vocabulary than Llama 2. Developers could download the models for fine-tuning and self-hosting under the Llama 3 Community License. The launch also powered the updated Meta AI assistant, connecting the research model family to a consumer product without making the assistant and the raw checkpoints interchangeable.
Frequently asked questions
LLaMA 3 (8B/70B) was released by Meta on Thursday, Apr 18 2024.