A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.
An improved version of Mistral 7B Instruct, with the following changes:
Modalities
Context
33K
Released
Dec 28, 2023
Knowledge Cutoff
Sep 2023
A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length. An improved version of Mistral 7B Instruct, with the following changes: - 32k context window (vs 8k context in v0.1) - Rope-theta = 1e6 - No Sliding-Window Attention
Mistral 7B Instruct v0.2 has a 32,768 token context window.
Mistral Medium 3.5, Mistral Small 4, Ministral 3 14B 2512 and 15 more are other text models from Mistral AI.
Mistral 7B Instruct v0.2 was released on December 28, 2023. Its knowledge cutoff is September 30, 2023.
Token volume and request traffic to this model over time.