Claude 3.5 Sonnet (upgraded) vs Mistral NeMo
Anthropic Claude 3.5 Sonnet (upgraded) | Mistral Mistral NeMo | |
|---|---|---|
| Overview | ||
| Company | Anthropic | Mistral |
| Release date | Oct 22 2024 | Jul 18 2024 |
| Access | Proprietary | Open Weight |
| Specifications | ||
Parameters | — | 12B |
Context window | — | 128k |
| Benchmarks | ||
Coding SWE-Bench VerifiedReal coding tasks pulled from open-source projects — the AI has to find and fix actual bugs. A human-checked version of the original SWE-Bench. Higher is better. | 49% | — |
| Timeline | ||
| Release gap | Mistral NeMo shipped 96 days before Claude 3.5 Sonnet (upgraded) | |
Which is better: Claude 3.5 Sonnet (upgraded) or Mistral NeMo?
Claude 3.5 Sonnet (upgraded) and Mistral NeMo don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Mistral NeMo shipped 96 days before Claude 3.5 Sonnet (upgraded), so benchmark comparisons should account for the intervening progress.
Claude 3.5 Sonnet (upgraded) is proprietary, while Mistral NeMo is open weight.
Direct benchmark comparisons are unavailable — Claude 3.5 Sonnet (upgraded) and Mistral NeMo don't publish scores on any of the same benchmarks.
Frequently asked questions
Claude 3.5 Sonnet (upgraded) was released by Anthropic on Oct 22 2024.
Mistral NeMo was released by Mistral on Jul 18 2024.
Claude 3.5 Sonnet (upgraded) is a proprietary model released by Anthropic. Mistral NeMo is an open weight model released by Mistral.