LLaMA 3.1 vs Mistral Medium
Meta LLaMA 3.1 | Mistral Mistral Medium | |
|---|---|---|
| Overview | ||
| Company | Meta | Mistral |
| Release date | Jul 23 2024 | Dec 2023 |
| Access | Open Weight | Proprietary |
| Benchmarks | ||
Nonsense detection BullshitBench v2Given a confidently-worded but nonsensical prompt, does the AI spot that it makes no sense and push back — instead of playing along and inventing an answer? The score is how often it clearly called out the nonsense. Higher is better. | 14% | — |
| Timeline | ||
| Release gap | Mistral Medium shipped 235 days before LLaMA 3.1 | |
Which is better: LLaMA 3.1 or Mistral Medium?
LLaMA 3.1 and Mistral Medium don't publish scores on any of the same benchmarks, so there's no direct head-to-head comparison. Mistral Medium shipped 235 days before LLaMA 3.1, so benchmark comparisons should account for the intervening progress.
LLaMA 3.1 is open weight, while Mistral Medium is proprietary.
Direct benchmark comparisons are unavailable — LLaMA 3.1 and Mistral Medium don't publish scores on any of the same benchmarks.
Frequently asked questions
LLaMA 3.1 was released by Meta on Jul 23 2024.
Mistral Medium was released by Mistral on Dec 2023.
LLaMA 3.1 is an open weight model released by Meta. Mistral Medium is a proprietary model released by Mistral.
Other comparisons
LLaMA 3.1 vs Claude Sonnet 5Mistral Medium vs Claude Sonnet 5LLaMA 3.1 vs GPT-5.6 SolMistral Medium vs GPT-5.6 SolLLaMA 3.1 vs Gemini OmniMistral Medium vs Gemini OmniLLaMA 3.1 vs Grok 4.5Mistral Medium vs Grok 4.5LLaMA 3.1 vs DeepSeek-V4-ProMistral Medium vs DeepSeek-V4-ProLLaMA 3.1 vs Kimi K2.7 CodeMistral Medium vs Kimi K2.7 Code