# Llama 3.1 Nemotron 51B

Llama 3.1 Nemotron 51B is an AI model released by NVIDIA on Sep 23 2024. It has 51B parameters, a 128k context window and open weight.

## Facts

| Field | Value |
| --- | --- |
| Model | Llama 3.1 Nemotron 51B |
| Developer | NVIDIA |
| Release date | Monday, Sep 23 2024 |
| Licensing | Open Weight |
| Parameters | 51B |
| Context window | 128k |

## Tracked benchmark scores

| Benchmark | Score | Source | What it measures |
| --- | --- | --- | --- |
| ARC-Challenge | 69.2% | Lab | multiple-choice science questions from the AI2 Reasoning Challenge; unrelated to ARC-AGI |
| HellaSwag | 85.58% | Lab | commonsense completion of short scenarios |
| WinoGrande | 84.53% | Lab | resolving ambiguous pronouns in context |
| MMLU | 80.2% | Lab | A 57-subject multiple-choice exam — history, law, medicine, maths — that was the standard measure of how much a model knows from 2020 until roughly 2024, when frontier scores crowded into the high 80s and labs moved on to harder tests. The scores here were published years apart under different testing setups, so read them as a historical record rather than a like-for-like ranking. Higher is better. |
| GSM8K | 91.43% | Lab | Grade-school maths word problems that take a few steps of arithmetic to work through. It separated the models of 2022 and 2023 sharply, then saturated. One caveat on the historical numbers: OpenAI included part of the GSM8K training set in GPT-4's pre-training mix, so GPT-4's score is not a clean few-shot result. Higher is better. |

## About Llama 3.1 Nemotron 51B

Llama 3.1 Nemotron 51B was released in September 2024 as a compressed derivative of Meta’s Llama 3.1 70B Instruct. NVIDIA used neural architecture search and block distillation to target single-GPU inference.

The 51B Instruct checkpoint shipped with an NVIDIA NIM deployment and downloadable weights. Its model card reported 80.2% on five-shot MMLU and 91.43% on five-shot GSM8K.

## Questions and answers

### When was Llama 3.1 Nemotron 51B released?

Llama 3.1 Nemotron 51B was released by NVIDIA on Monday, Sep 23 2024.

### Who made Llama 3.1 Nemotron 51B?

Llama 3.1 Nemotron 51B was built by NVIDIA. The dominant AI chipmaker, publishing the open Nemotron model family. Ships weights, datasets and training recipes to seed demand for its hardware rather than to sell a chatbot.

### What benchmark scores did Llama 3.1 Nemotron 51B get?

Llama 3.1 Nemotron 51B reports 5 tracked benchmark scores — ARC-Challenge: 69.2%; HellaSwag: 85.58%; WinoGrande: 84.53%; MMLU: 80.2%; GSM8K: 91.43%. Tracked scores may come from lab reports or independent benchmarks; source details accompany the benchmark data.

### What is the context window of Llama 3.1 Nemotron 51B?

Llama 3.1 Nemotron 51B has a context window of 128k. Providers may specify separate input and output token limits.

### How many parameters does Llama 3.1 Nemotron 51B have?

Llama 3.1 Nemotron 51B is reported at 51B parameters.

### Is Llama 3.1 Nemotron 51B open source?

Partly. Llama 3.1 Nemotron 51B is an open-weight model: the trained weights are free to download and run locally or on your own infrastructure, but the training data and code are not fully released and the license may restrict some commercial uses. It is not open source in the strict sense.

### What came before and after Llama 3.1 Nemotron 51B?

NVIDIA's previous tracked release was Mistral NeMo Minitron 8B on Aug 21 2024, 33 days earlier. It was followed by Llama 3.1 Nemotron 70B on Oct 15 2024.


---

Canonical page: https://aireleasetracker.com/model/nvidia/llama-3.1-nemotron-51b
Site index: https://aireleasetracker.com/llms.txt
Source: AI Release Tracker (https://aireleasetracker.com). Most benchmark scores come from lab launch material; gathered results identify the leaderboard that published them.
