Chutes (SN64) published a draft tech report on Parallax, the model training method the team has been experimenting with for decentralized MoE (Mixture of Experts) training. The report proposes splitting MoE routed experts across participants … Continue reading Chutes (SN64) Releases Parallax, a New Blueprint for Decentralized MoE Training