Llama Nemotron Ultra 253BOpen Weight

Released

Llama Nemotron Ultra 253B is an AI model released by NVIDIA on Monday, Apr 7 2025, 20 days after Llama Nemotron (Nano/Super). It is an open-weight model — the trained weights are available to download and run. It is a 253B parameterThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. model with a 128k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.. Benchmark results (shown below) cover LiveCodeBench, and GPQA Diamond.

Benchmarks

Coding

LiveCodeBenchCompetitive coding — Coding problems published so recently the AI can't have seen them in training — a contamination-free test of raw programming skill. Higher is better.
66.3%
#21 of 36

Reasoning & science

GPQA DiamondScience — Graduate-level science questions in biology, physics, and chemistry — hard enough that subject-matter PhDs score around 65%. Higher is better.
76%
#62 of 100

Compare Llama Nemotron Ultra 253B with

Llama Nemotron Ultra 253B

About

Llama Nemotron Ultra 253B was released in April 2025 as the largest tier of NVIDIA's Llama Nemotron reasoning family. It was derived from Meta's Llama 3.1 405B using neural architecture search to reduce the model to approximately 253 billion parameters. The aim was to retain strong capability while making deployment more efficient than the original foundation model.

The model supported reasoning and non-reasoning modes and a 128,000-token context. NVIDIA documented deployment on a single eight-GPU H100 node, with requirements dependent on precision and serving configuration. The released weights provided a large self-hosted reasoning model derived from Llama, rather than a consumer assistant service.

Frequently asked questions

Llama Nemotron Ultra 253B was released by NVIDIA on Monday, Apr 7 2025.

All NVIDIA releases

12 tracked