Model ReleasesMixtral 8x7B: The Open-Source Mixture of Experts Revolution That Matches GPT-3.5Mistral AI's groundbreaking 46.7B parameter MoE model delivers GPT-3.5-level performance with just 12.9B active parameters.over 2 years ago6 min readRead article