Nonsense detection
BullshitBench v2
Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better.
Rankings
Higher is better195%
Claude Opus 4.8
Anthropic · May 28 2026
291%
Claude Sonnet 4.6
Anthropic · Feb 17 2026
390%
Claude Opus 4.5
Anthropic · Nov 24 2025
487%
Claude Opus 4.6
Anthropic · Feb 5 2026
583%
Claude Opus 4.7
Anthropic · Apr 16 2026
680%
Claude Sonnet 5
Anthropic · Jun 30 2026
779%
Claude Sonnet 4.5
Anthropic · Sep 29 2025
877%
Claude Haiku 4.5
Anthropic · Oct 15 2025
973%
Kimi K3
Moonshot AI · Jul 16 2026
1065%
Kimi K2.6
Moonshot AI · Apr 21 2026
1156%
Grok 4.20 Beta
SpaceXAI · Feb 17 2026
1254%
Claude Fable 5
Anthropic · Jun 9 2026
1254%
Grok 4.5
SpaceXAI · Jul 8 2026
1453%
GPT-5.6 Terra
OpenAI · Jun 26 2026
1552%
Kimi K2.5
Moonshot AI · Jan 27 2026
1650%
Claude 3.5 Haiku
Anthropic · Oct 22 2024
1650%
Grok 4.3 Beta
SpaceXAI · Apr 17 2026
1849%
Claude 3.7 Sonnet
Anthropic · Feb 24 2025
1948%
GPT-5.4
OpenAI · Mar 5 2026
2047%
GPT-5.5
OpenAI · Apr 23 2026
2047%
GPT-5.6 Sol
OpenAI · Jun 26 2026
2245%
Claude 3.5 Sonnet
Anthropic · Jun 20 2024
2343%
Claude Opus 4.1
Anthropic · Aug 5 2025
2440%
GPT-5.6 Luna
OpenAI · Jun 26 2026
2539%
GPT-5-Codex
OpenAI · Sep 15 2025
2638%
GPT-5.2
OpenAI · Dec 11 2025
2737%
Gemini 3.1 Pro
Google · Feb 19 2026
2836%
GPT-5.5-Pro
OpenAI · Apr 23 2026
2934%
Claude Opus 4
Anthropic · May 22 2025
3032%
GPT-5.4 mini
OpenAI · Mar 17 2026
3131%
GLM-5.2
Z.ai · Jun 16 2026
3230%
Claude Sonnet 4
Anthropic · May 22 2025
3328%
LLaMA 4 Maverick
Meta · Apr 5 2025
3328%
GLM-5
Z.ai · Feb 12 2026
3526%
o3
OpenAI · Apr 16 2025
3625%
GPT-5.1
OpenAI · Nov 12 2025
3724%
GPT-5.3-Codex
OpenAI · Feb 5 2026
3822%
GLM-5.1
Z.ai · Apr 7 2026
3921%
GPT-5
OpenAI · Aug 7 2025
4020%
Gemini 2.5 Pro
Google · Mar 25 2025
4020%
Gemini 3.5 Flash
Google · May 19 2026
4219%
LLaMA 4 Scout
Meta · Apr 5 2025
4219%
Gemini 2.5 Flash
Google · Apr 17 2025
4219%
Grok 4.1 Fast
SpaceXAI · Nov 19 2025
4518%
DeepSeek-V4-Flash
DeepSeek · Apr 24 2026
4615%
Gemini 2.0 Flash
Google · Jan 30 2025
4714%
LLaMA 3.1
Meta · Jul 23 2024
4714%
GPT-4.1
OpenAI · Apr 14 2025
4714%
GPT-5.4 nano
OpenAI · Mar 17 2026
4714%
DeepSeek-V4-Pro
DeepSeek · Apr 24 2026
5113%
DeepSeek-V3.2
DeepSeek · Dec 1 2025
5212%
GPT-4o
OpenAI · May 13 2024
5311%
gpt-oss-120b
OpenAI · Aug 5 2025
5311%
Gemini 3.1 Flash-Lite
Google · Mar 3 2026
5510%
Claude 3 Haiku
Anthropic · Mar 4 2024
5510%
Kimi K2
Moonshot AI · Jul 11 2025
578%
o4-mini
OpenAI · Apr 16 2025
578%
DeepSeek R1-0528
DeepSeek · May 28 2025
578%
GLM-4.5
Z.ai · Jul 28 2025
602%
GPT-4o mini
OpenAI · Jul 18 2024