mixture-of-experts
2 stories tagged “mixture-of-experts”.
-
Reflection's Beam emerges as the most capable open-weight model developed outside China
Reflection Beam is an open-weight MoE coding model from Reflection, using 23B active parameters and large RL r…
-
StepFun Unveils Step 5 Preview: A Mixture-of-Experts Model with 600B Parameters (27B Active) and 1M-Context Window Built for Extended Agentic Tasks
StepFun launched Step 5 Preview, a 600B-parameter sparse MoE model with 27B active per token, a 92-layer deep …