Compare AI models

Specifications
Parameters
—8B
Context window
100k8k
Benchmarks
HumanEval
58.7%36.22%
GSM8K
86.7%58.45%
Overview
CompanyAnthropicNVIDIA
Release dateAug 9 2023Aug 21 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Claude Instant 1.2 leads Mistral NeMo Minitron 8B on 2 of the 2 benchmarks they both report (HumanEval, GSM8K). Claude Instant 1.2 shipped 378 days before Mistral NeMo Minitron 8B, so benchmark comparisons should account for the intervening progress.

Context windows are 100k (Claude Instant 1.2) vs 8k (Mistral NeMo Minitron 8B). Claude Instant 1.2 is closed, while Mistral NeMo Minitron 8B is open weight.

On HumanEval, Claude Instant 1.2 leads at 58.7% vs Mistral NeMo Minitron 8B at 36.22%. On GSM8K, Claude Instant 1.2 leads at 86.7% vs Mistral NeMo Minitron 8B at 58.45%.