Mistral 7B v0.3Open Weight

Released

Mistral 7B v0.3 is an AI model released by Mistral on Wednesday, May 22 2024, 42 days after Mixtral 8×22B. It is an open-weight model — the trained weights are available to download and run. It is a 7B parameterThe learned values that shape how a model responds. B means billion and T means trillion. For mixture-of-experts models, the total count is larger than the number active for each token. Parameter count alone does not measure quality. model with a 32k token context windowHow much information the model can work with in one request, measured in tokens — pieces of words or other data. This includes your question, attachments, conversation and reply. Limits can vary by model variant and provider.. Benchmark results (shown below) cover HumanEval, and MATH.

Benchmarks

Coding

HumanEvalFunction synthesis — 164 small Python problems: the AI is given a function's description and has to write the working function. This was the coding benchmark of the GPT-3.5 and GPT-4 era, before the field moved to fixing real bugs in real repositories. Higher is better.
38.4%
#61 of 65

Reasoning & science

MATHReasoning — accuracy on the original competition mathematics test set
13.2%
#42 of 43

Compare Mistral 7B v0.3 with

Mistral 7B v0.3

About

Mistral 7B v0.3 was released on May 22, 2024 as a further update to Mistral's original compact language-model family. The release expanded the vocabulary and adopted the v3 tokenizer. Its instruction checkpoint added function calling, allowing an application to request structured tool invocations alongside ordinary text responses.

Mistral published base and instruction weights under Apache 2.0, retaining a 32K-token context. The function-calling interface made the instructed version useful as a local component in applications that connected a small model to external services. The benchmark results recorded here describe the instruction checkpoint, rather than the original September 2023 base model.

Frequently asked questions

Mistral 7B v0.3 was released by Mistral on Wednesday, May 22 2024.

All Mistral releases

45 tracked