Compare AI models

Specifications
Parameters
340B7B/14B
Context window
4k1M
Benchmarks
HumanEval
73.2%88.4%
IFEval
79.9%84.3%
GSM8K
92.3%94.8%
Overview
CompanyNVIDIAQwen
Release dateJun 14 2024Jan 27 2025
AccessOpen WeightOpen Weight
Model detailsView modelView model

Frequently asked questions

Qwen2.5-1M leads Nemotron-4 340B on 3 of the 3 benchmarks they both report (HumanEval, IFEval, GSM8K). Nemotron-4 340B shipped 227 days before Qwen2.5-1M, so benchmark comparisons should account for the intervening progress.

Nemotron-4 340B has 340B parameters, while Qwen2.5-1M has 7B/14B. Context windows are 4k (Nemotron-4 340B) vs 1M (Qwen2.5-1M).

On HumanEval, Qwen2.5-1M leads at 88.4% vs Nemotron-4 340B at 73.2%. On IFEval, Qwen2.5-1M leads at 84.3% vs Nemotron-4 340B at 79.9%. On GSM8K, Qwen2.5-1M leads at 94.8% vs Nemotron-4 340B at 92.3%.