[AUTOGENESIS][Phase II] The Sovereign Foundry — distributed training pipeline on commodity hardware #423
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Parent Epic: #421
Mission
Build a distributed training pipeline that can train a 1B–3B parameter coding model entirely on sovereign/commodity hardware.
Deliverables
train/pipeline.py— data curation, tokenization, distributed training orchestrationtrain/hardware_mesh.py— node discovery and gradient sync over Nostr or raw socketstrain/benchmark.py— internal coding benchmark suitegemma-3:4bon our benchmarkAcceptance Criteria