Compare AI models

API pricingUSD per 1M tokens · lower wins
Input priceWhat you pay for everything you send the model — your question, plus any documents or earlier conversation you include with it.
—$1.10
Output priceWhat you pay for the text the model writes back. It is normally the dearer half: producing an answer costs more than reading one.
—$4.40
Cached input priceA reduced rate for text you send over and over. If every request starts with the same instructions or the same document, the provider keeps a copy ready and charges less to read it again.
—$0.275
Cheapest inputLowest input rate across every provider on OpenRouter, the lab included. The cheapest endpoint may run a quantised build or a shorter context — see "Available from" on the model page.
$0.10DeepInfra$1.10OpenAI
Cheapest outputLowest output rate across every provider on OpenRouter, the lab included. May come from a different provider than the cheapest input.
$0.30DeepInfra$4.40OpenAI
$35.00DeepInfra · fp8$440OpenAI list price
Benchmarks
BullshitBench v2Nonsense detection — Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better.
20%8%
Overview
CompanyMetaOpenAI
Release dateApr 5 2025Apr 16 2025
AccessOpen WeightClosed
Model detailsView modelView model

Frequently asked questions

LLaMA 4 Scout leads o4-mini on 1 of the 1 benchmark they both report (BullshitBench v2). Only o4-mini has a verified first-party API price: $1.10 per million input tokens and $4.40 per million output tokens. No pay-as-you-go API rate is tracked for LLaMA 4 Scout. LLaMA 4 Scout shipped 11 days before o4-mini, so benchmark comparisons should account for the intervening progress.

LLaMA 4 Scout is open weight, while o4-mini is closed.

On BullshitBench v2, LLaMA 4 Scout leads at 20% vs o4-mini at 8%.