# Nemotron-4 340B

Nemotron-4 340B is an AI model released by NVIDIA on Jun 14 2024. It has 340B parameters and open weight.

## Facts

| Field | Value |
| --- | --- |
| Model | Nemotron-4 340B |
| Developer | NVIDIA |
| Release date | Friday, Jun 14 2024 |
| Licensing | Open Weight |
| Parameters | 340B |

## About Nemotron-4 340B

Nemotron-4 340B, released June 14, 2024, was the point at which NVIDIA stopped being only the company every other lab trained on and started publishing frontier-scale models of its own. It was a 340-billion-parameter dense family — Base, Instruct and Reward — pre-trained on 9 trillion tokens and put out under the NVIDIA Open Model License, which permitted commercial use of the models and their outputs. At the time only Meta had published open weights anywhere near that size.

The pitch was unusual: NVIDIA framed the release around synthetic data generation rather than chat, noting that over 98% of the data used in the Instruct model's alignment had itself been generated synthetically, and pairing it with a Reward model that quickly became a standard judge for other labs' data pipelines. That posture — publish the machinery, sell the hardware it runs on — is the strategy every later Nemotron release repeated.

## Questions and answers

### When was Nemotron-4 340B released?

Nemotron-4 340B was released by NVIDIA on Friday, Jun 14 2024.

### Who made Nemotron-4 340B?

Nemotron-4 340B was built by NVIDIA. The dominant AI chipmaker, publishing the open Nemotron model family. Ships weights, datasets and training recipes to seed demand for its hardware rather than to sell a chatbot.

### How many parameters does Nemotron-4 340B have?

Nemotron-4 340B is reported at 340B parameters.

### Is Nemotron-4 340B open source?

Partly. Nemotron-4 340B is an open-weight model: the trained weights are free to download and run locally or on your own infrastructure, but the training data and code are not fully released and the license may restrict some commercial uses. It is not open source in the strict sense.

### What came before and after Nemotron-4 340B?

It was followed by Llama 3.1 Nemotron 70B on Oct 15 2024.


---

Canonical page: https://aireleasetracker.com/model/nvidia/nemotron-4-340b
Full dataset: https://aireleasetracker.com/llms-full.txt · JSON: https://aireleasetracker.com/models.json
Source: AI Release Tracker (https://aireleasetracker.com). Benchmark scores are the figures published by the releasing lab at launch.