Mistral: Mixtral 8x22B (base)
mistralai/mixtral-8x22b
Mixtral 8x22B is a large-scale language model from Mistral AI. It consists of 8 experts, each 22 billion parameters, with each token using 2 experts at a time.
It was released via X(opens in new tab).
#moe
Modalities
Context
66K
Knowledge Cutoff
Jan 31, 2024