Compare AI models

API pricingUSD per 1M tokens · lower wins
Cheapest inputLowest input rate across every provider on OpenRouter, the lab included. The cheapest endpoint may run a quantised build or a shorter context — see "Available from" on the model page.
$0.10DeepInfra—
Cheapest outputLowest output rate across every provider on OpenRouter, the lab included. May come from a different provider than the cheapest input.
$0.30DeepInfra—
$35.00DeepInfra · fp8—
Benchmarks
BullshitBench v2Nonsense detection — Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better.
20%39%
Overview
CompanyMetaOpenAI
Release dateApr 5 2025Sep 15 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

GPT-5-Codex leads LLaMA 4 Scout on 1 of the 1 benchmark they both report (BullshitBench v2). LLaMA 4 Scout shipped 163 days before GPT-5-Codex, so benchmark comparisons should account for the intervening progress.

LLaMA 4 Scout is open weight, while GPT-5-Codex is closed.

On BullshitBench v2, GPT-5-Codex leads at 39% vs LLaMA 4 Scout at 20%.