2 vs 0 benchmarks won
Anthropic Claude 3.5 Haiku | xAI Grok Code Fast 1 | |
|---|---|---|
| Overview | ||
| Company | Anthropic | xAI |
| Release date | Oct 22 2024 | Aug 28 2025 |
| Model type | — | — |
| Open source | No | No |
| Specifications | ||
Parameters | — | — |
Context window | — | — |
| Benchmarks | ||
Science reasoning GPQA Diamond | 41.6% | — |
Software engineering SWE-Bench Verified | 40.6% | — |
Multimodal understanding MMMU | — | — |
| Timeline | ||
| Release gap | Claude 3.5 Haiku shipped 310 days before Grok Code Fast 1 | |
Claude 3.5 Haiku leads Grok Code Fast 1 on 2 of the tracked benchmarks (GPQA Diamond, SWE-Bench Verified, MMMU). Claude 3.5 Haiku shipped 310 days before Grok Code Fast 1, so benchmark comparisons should account for the intervening progress.
Published specifications for these two models are limited — see each model page for the latest details.
Direct benchmark comparisons are unavailable — at least one of these models has not published scores on GPQA Diamond, SWE-Bench Verified, or MMMU.