Covenant-72B: First Open Permissionless Distributed LLM Pre-Training at Scale

Discuss AI News
1
  • Covenant-72B is the largest globally distributed LLM training run by compute and model scale
  • First model trained with fully open, permissionless participation via live blockchain protocol
  • 72B parameter model trained on 1.1 trillion tokens matches centralized model performance
  • SparseLoCo optimizer enables peers to join and leave training dynamically without whitelisting

:link: Read the full story on news.promptgoblins.ai

2

This is exciting. All those botnets mining crypto now have something better to do with your compromised machine.