Mixtral 8×7BOpen Weight
Released
Mixtral 8×7B is an AI model released by Mistral on Friday, Dec 8 2023, 72 days after Mistral 7B. It is an open-weight model — the trained weights are available to download and run.
Get Mistral releases and AI news.
One email, every other Monday.
Compare Mixtral 8×7B with
Suggested comparisons
Mixtral 8×7BvsMistral Medium 3.5Mixtral 8×7BvsGPT-6 AstraMixtral 8×7BvsClaude Fable 5.1Mixtral 8×7BvsGemini 3.8 FlashMixtral 8×7BvsMuse Spark 1.3Mixtral 8×7BvsGrok 4.7Mixtral 8×7BvsDeepSeek-V4.1-FlashMixtral 8×7BvsKimi K3Mixtral 8×7BvsGLM-5.3-FlashMixtral 8×7BvsQwen3.8-Max-0902Mixtral 8×7BvsNemotron 3.5 LightningAbout
Mixtral 8×7B, released December 8, 2023 — again as an unceremonious magnet link — brought sparse mixture-of-experts architecture to the open ecosystem. With eight expert networks of which two activate per token (~13B active of 47B total), it matched or beat GPT-3.5 and Llama 2 70B while inferring at the speed of a much smaller model, all under Apache 2.0.
It was many developers' first hands-on proof that MoE was the future of efficient scaling, months before it became known that GPT-4 itself used the technique. Mixtral powered a generation of open chat products and was followed by the larger Mixtral 8×22B in April 2024.
Frequently asked questions
Mixtral 8×7B was released by Mistral on Friday, Dec 8 2023.