# Mixtral 8×7B

Mixtral 8×7B is an AI model released by Mistral on Dec 8 2023. It has 47B parameters, a 32k context window and open weight.

## Facts

| Field | Value |
| --- | --- |
| Model | Mixtral 8×7B |
| Developer | Mistral |
| Release date | Friday, Dec 8 2023 |
| Licensing | Open Weight |
| Parameters | 47B |
| Context window | 32k |

## About Mixtral 8×7B

Mixtral 8×7B, released December 8, 2023 — again as an unceremonious magnet link — brought sparse mixture-of-experts architecture to the open ecosystem. With eight expert networks of which two activate per token (~13B active of 47B total), it matched or beat GPT-3.5 and Llama 2 70B while inferring at the speed of a much smaller model, all under Apache 2.0.

It was many developers' first hands-on proof that MoE was the future of efficient scaling, months before it became known that GPT-4 itself used the technique. Mixtral powered a generation of open chat products and was followed by the larger Mixtral 8×22B in April 2024.

## Questions and answers

### When was Mixtral 8×7B released?

Mixtral 8×7B was released by Mistral on Friday, Dec 8 2023.

### Who made Mixtral 8×7B?

Mixtral 8×7B was built by Mistral. French AI company building open and commercial models. Founded in 2023 by former Meta and DeepMind researchers.

### What is the context window of Mixtral 8×7B?

Mixtral 8×7B has a context window of 32k. That is the maximum amount of input plus output the model can hold in a single request.

### How many parameters does Mixtral 8×7B have?

Mixtral 8×7B is reported at 47B parameters.

### Is Mixtral 8×7B open source?

Partly. Mixtral 8×7B is an open-weight model: the trained weights are free to download and run locally or on your own infrastructure, but the training data and code are not fully released and the license may restrict some commercial uses. It is not open source in the strict sense.

### What came before and after Mixtral 8×7B?

Mistral's previous tracked release was Mistral 7B on Sep 27 2023, 72 days earlier. It was followed by Mistral Medium on Dec 11 2023.


---

Canonical page: https://aireleasetracker.com/model/mistral/mixtral-8×7b
Site index: https://aireleasetracker.com/llms.txt
Source: AI Release Tracker (https://aireleasetracker.com). Most benchmark scores come from lab launch material; gathered results identify the leaderboard that published them.