When AI companies like OpenAI or Anthropic build models like ChatGPT or Claude, they don’t just train the model once and ship it. They spend months doing something called “post-training”, teaching the model to actually […]
Templar, Bittensor Subnet 3, has completed pre-training for Covenant72B, a 72-billion-parameter language model. This is the largest frontier-scale model ever trained in a fully permissionless and decentralized setting. The run was coordinated across a global […]
By: CryptoZPunisher Templar on Bittensor: when the impossible becomes possible On Bittensor, everything is possible. And if there were one concrete proof, Templar is probably among the most striking. The Templar team has just published […]
SUMMARY: On TGIF #20, Covenant Labs announced Templar’s latest evolution in decentralized training, moving toward a “unified training” paradigm that combines data and model parallelism. By integrating their state-of-the-art SparseLoCO algorithm with new model-sharding techniques, […]
For a long time, “Decentralized AI Training” was viewed as a science experiment, cool in theory but impossible in practice. The narrative was simple: “You can’t train massive AI models across the internet. It’s too […]
SUMMARY: This episode of Covenant’s TGIF community chat walked through a major milestone in building an end-to-end open weights AI model fully trained on Bittensor. The team explained they reached checkpoint two, released a working […]
SUMMARY: Covenant Labs delivered the 17th episode of TGIF at the NeurIPS conference in San Diego, highlighting major progress across Templar, Basilica and the broader Covenant 72B initiative. The brief emphasized how Templar unlocks decentralized […]
Contributor: School of Crypto It wasn’t supposed to be possible to pre-train a foundational model off the internet alone. The consensus in the A.I. Industry was clear: you needed massive datacenters with expensive cooling systems, […]
In an industry defined by scale, secrecy, and billion-dollar data centers, Covenant is attempting something that borders on the unthinkable: making frontier-model pre-training accessible to the entire world. On Hash Rate Pod’s episode 145 (see […]
The latest TGIF community call opened with a relaxed tone, but Samuel ‘Sam’ Dare quickly made it clear that Covenant Labs has entered a period where focus and honesty takes precedence over casual conversation. Bittensor […]
© Copyright 2026 The TAO Daily