Which AI model scores highest on SimpleQA?

GPT-4.5 by OpenAI holds the best SimpleQA result among tracked models, at 62.5% (released Feb 27 2025). Higher scores are better on this benchmark.

What are the top 5 models on SimpleQA?

1. GPT-4.5 (OpenAI) — 62.5%; 2. Gemini 2.5 Pro (Google) — 52.9%; 3. o3 (OpenAI) — 49.4%; 4. Gemini 2.0 Pro (Google) — 44.3%; 5. GPT-4.1 (OpenAI) — 41.6%.

How many models have a published SimpleQA score?

15 tracked models have a published SimpleQA score. Scores are collected from published lab reports and benchmark sources, with recorded sources credited alongside the results. We do not re-run the evaluations.

What is the best open model on SimpleQA?

Gemma 3 by Google is the highest-ranked model with downloadable weights on SimpleQA, scoring 10% at rank 14 overall.

Knowledge

SimpleQA

accuracy on short, fact-seeking questions in the original SimpleQA set

Rankings

Higher is better

Gemini 2.0 Flash-Lite

Gemini 2.5 Flash-Lite

SimpleQA — frequently asked questions

: accuracy on short, fact-seeking questions in the original SimpleQA set
: GPT-4.5 by OpenAI holds the best SimpleQA result among tracked models, at 62.5% (released Feb 27 2025). Higher scores are better on this benchmark.
: 1. GPT-4.5 (OpenAI) — 62.5%; 2. Gemini 2.5 Pro (Google) — 52.9%; 3. o3 (OpenAI) — 49.4%; 4. Gemini 2.0 Pro (Google) — 44.3%; 5. GPT-4.1 (OpenAI) — 41.6%.
: 15 tracked models have a published SimpleQA score. Scores are collected from published lab reports and benchmark sources, with recorded sources credited alongside the results. We do not re-run the evaluations.
: Gemma 3 by Google is the highest-ranked model with downloadable weights on SimpleQA, scoring 10% at rank 14 overall.