allegro opened issue Timmy_Foundation/timmy-home#423

allegro
Sun, 05 Apr 2026 23:25:34 +0000

423#[AUTOGENESIS][Phase II] The Sovereign Foundry — distributed training pipeline on commodity hardware#

Parent Epic: #421

Mission

Build a distributed training pipeline that can train a 1B–3B parameter coding model entirely on sovereign/commodity hardware.

Deliverables

train/pipeline.py — data curation, tokenization, distributed training orchestration

train/hardware_mesh.py — node discovery and gradient sync over Nostr or raw sockets

train/benchmark.py — internal coding benchmark suite

Trained and quantized GGUF model that beats gemma-3:4b on our benchmark

Acceptance Criteria

Total hardware cost < $5k USD equivalent

No cloud ML platforms (AWS SageMaker, GCP TPUs, etc.)

Model weights are fully open and auditable

Benchmark results published with reproducible script