Macrocosmos

Home
Protein Folding
Pretraining
Fine-Tuning
Data Scraping
Language Models
About

Pre-Training

SN9: Dataset mixing delivers SOTA results
Last month, we announced that Subnet 9, Pre-training, would be enabling dataset mixing - so what were our preliminary results?
 • 
Macrocosmos
Distributed learning for decentralized LLMs: preliminary results
Breaking down our federated learning experiment.
 • 
Macrocosmos
SN9’s smarter dataset mixing: pushing the limits of our pre-training subnet (part 1)
Producing SOTA results with a data-centric approach.
 • 
Macrocosmos
Monsters, vampires, and X-rays: subnet 9’s Halloween deep dive
Revealing the ghoulish, trick-or-treat tactics miners are incorporating into our pre-training subnet
 • 
Macrocosmos
More oversight, better visibility: The relaunched SN9 Leaderboards
We're expanding our reporting and benchmarking for Subnet 9, bringing more granular data to the Bittensor community.
 • 
Macrocosmos
Data determinant? Why we’re updating the datasets on SN9 to improve performance
LLMs are even more dependent on their dataset than first thought. To unlock performance, higher-quality datasets are essential - which is why we're…
 • 
Macrocosmos
Subnet 9: Scaling up parameters to further Bittensor’s founding mission
There’s a growing awareness that we must democratize access to trained AI models. But as well as access, we must also democratize the training process…
 • 
Macrocosmos
© 2025 Will Squires
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great culture