Compare AI models

Specifications
Parameters
8B8B
Context window
1M8k
Benchmarks
MMLU
68.1%69.51%
Overview
CompanyGoogleNVIDIA
Release dateOct 3 2024Aug 21 2024
AccessClosedOpen Weight
Model detailsView modelView model

Frequently asked questions

Mistral NeMo Minitron 8B leads Gemini 1.5 Flash-8B on 1 of the 1 benchmark they both report (MMLU). Mistral NeMo Minitron 8B shipped 43 days before Gemini 1.5 Flash-8B, so benchmark comparisons should account for the intervening progress.

Gemini 1.5 Flash-8B has 8B parameters, while Mistral NeMo Minitron 8B has 8B. Context windows are 1M (Gemini 1.5 Flash-8B) vs 8k (Mistral NeMo Minitron 8B). Gemini 1.5 Flash-8B is closed, while Mistral NeMo Minitron 8B is open weight.

On MMLU, Mistral NeMo Minitron 8B leads at 69.51% vs Gemini 1.5 Flash-8B at 68.1%.