Llama 3.1 Nemotron 51BOpen Weight
Released
Llama 3.1 Nemotron 51B is an AI model released by NVIDIA on Monday, Sep 23 2024, 33 days after Mistral NeMo Minitron 8B. It is an open-weight model — the trained weights are available to download and run. It is a 51B parameterThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. model with a 128k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.. Benchmark results (shown below) cover ARC-Challenge, HellaSwag, WinoGrande, MMLU, and GSM8K.
Get NVIDIA releases and AI news.
Every other Monday
Benchmarks
Compare Llama 3.1 Nemotron 51B with
Suggested comparisons
Llama 3.1 Nemotron 51BvsNemotron 3.5 Bolt E4B 4GBLlama 3.1 Nemotron 51BvsGPT-6.2 AstraLlama 3.1 Nemotron 51BvsClaude Fable 5.2Llama 3.1 Nemotron 51BvsGemini 4 NeonLlama 3.1 Nemotron 51BvsMuse EmberLlama 3.1 Nemotron 51BvsGrok 4.7Llama 3.1 Nemotron 51BvsDeepSeek-V4.1-Flash-1017Llama 3.1 Nemotron 51BvsMistral Large 4Llama 3.1 Nemotron 51BvsKimi K3.1 ProLlama 3.1 Nemotron 51BvsGLM-5.3-FlashLlama 3.1 Nemotron 51BvsQwen4-MaxAbout
Llama 3.1 Nemotron 51B was released in September 2024 as a compressed derivative of Meta’s Llama 3.1 70B Instruct. NVIDIA used neural architecture search and block distillation to target single-GPU inference.
The 51B Instruct checkpoint shipped with an NVIDIA NIM deployment and downloadable weights. Its model card reported 80.2% on five-shot MMLU and 91.43% on five-shot GSM8K.
Frequently asked questions
Llama 3.1 Nemotron 51B was released by NVIDIA on Monday, Sep 23 2024.