Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time.
It was released via X(opens in new tab).
#moe
Modalities
Context
66K
Released
Apr 10, 2024
Knowledge Cutoff
Jan 2024
Token volume and request traffic to this model over time.
Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time. It was released via X. #moe
Mixtral 8x22B (base) has a 65,536 token context window.
Mistral Medium 3.5, Mistral Small 4, Ministral 3 14B 2512 and 15 more are other text models from Mistral AI.
Mixtral 8x22B (base) was released on April 10, 2024. Its knowledge cutoff is January 31, 2024.