Glossary
Mixture of experts (MoE)
A model design where only a subset of parameters activates for each token, giving large capacity at lower inference cost.
Common in frontier and open-weight models. A 'total parameters' figure for an MoE model overstates its per-token compute.
Related terms
Active parametersGPUInferenceOpen-weight modelParameters
Get the brief in your inbox
One email every morning: the stories that mattered in AI, each with a one-line "why it matters" for your role. Free, no ads, unsubscribe any time.
Published daily by AI Briefing. We never share your address.