For most of the past year, the prevailing view among AI researchers has been that pretraining large models over the open internet is structurally impossible or so inefficient that it does not matter. Macrocosmos’s Orion-100B … Continue reading Macrocosmos’ Orion-100B Raises the Ceiling for Decentralized AI Training