OpenAI
o4-mini
o4-mini is an AI model released by OpenAI on Wednesday, Apr 16 2025, the same day as o3. Benchmark results (shown below) cover BullshitBench v2.
Benchmarks
Nonsense detection
BullshitBench v2Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better.
8%
#57 of 60Best: Claude Opus 4.8 · 95%