General knowledge
MMLU
A 57-subject multiple-choice exam — history, law, medicine, maths — that was the standard measure of how much a model knows from 2020 until roughly 2024, when frontier scores crowded into the high 80s and labs moved on to harder tests. The scores here were published years apart under different testing setups, so read them as a historical record rather than a like-for-like ranking. Higher is better.
Rankings
Higher is betterMMLU — frequently asked questions
- What is MMLU?
- A 57-subject multiple-choice exam — history, law, medicine, maths — that was the standard measure of how much a model knows from 2020 until roughly 2024, when frontier scores crowded into the high 80s and labs moved on to harder tests. The scores here were published years apart under different testing setups, so read them as a historical record rather than a like-for-like ranking. Higher is better.
- Which AI model scores highest on MMLU?
- GPT-4 by OpenAI holds the best MMLU result among tracked models, at 86.4% (released Mar 14 2023). Higher scores are better on this benchmark.
- What are the top 2 models on MMLU?
- 1. GPT-4 (OpenAI) — 86.4%; 2. Claude 2 (Anthropic) — 78.5%.
- How many models have a published MMLU score?
- 2 tracked models have a published MMLU score. Scores are the figures reported by each lab at that model's release, so this page is a record of results over time rather than a re-run leaderboard.