Timmy_Foundation/timmy-config
16
0
Fork 0
Code Issues 57 Pull Requests 1 Actions 1 Packages Projects Releases Wiki Activity

[PIPELINE] Train LoRA v0.3 on Hermes 4 14B base — first 14B adapter #10

New Issue
Closed
opened 2026-03-26 14:01:22 +00:00 by Timmy · 8 comments
Timmy commented 2026-03-26 14:01:22 +00:00
Owner
Copy Link

Context

We have 3 LoRA adapters trained on Hermes 3 8B (v0, v0.1, v0.2). Time to move to the 14B base.

Prerequisites

  • timmy-config #9 — Hermes 4 14B MLX model downloaded
  • timmy-config #5 — DPO trainer exists (or SFT first)

Steps

  1. Update ~/autolora/ config to point to ~/models/hermes4-14b-mlx/ as base model
  2. Use existing curated training data from training/data/
  3. Train LoRA with MLX: rank 16, lr 1e-6, 1000 steps (same as v0.2)
  4. Save adapter to ~/autolora/adapters/timmy-v0.3/
  5. Verify adapter loads and generates coherent output

Acceptance criteria

  • adapters/timmy-v0.3/adapters.safetensors exists
  • Training loss decreases over steps (paste loss curve)
  • mlx_lm.generate with adapter produces Timmy-sounding output
## Context We have 3 LoRA adapters trained on Hermes 3 8B (v0, v0.1, v0.2). Time to move to the 14B base. ## Prerequisites - [x] timmy-config #9 — Hermes 4 14B MLX model downloaded - [x] timmy-config #5 — DPO trainer exists (or SFT first) ## Steps 1. Update ~/autolora/ config to point to `~/models/hermes4-14b-mlx/` as base model 2. Use existing curated training data from `training/data/` 3. Train LoRA with MLX: rank 16, lr 1e-6, 1000 steps (same as v0.2) 4. Save adapter to `~/autolora/adapters/timmy-v0.3/` 5. Verify adapter loads and generates coherent output ## Acceptance criteria - [ ] `adapters/timmy-v0.3/adapters.safetensors` exists - [ ] Training loss decreases over steps (paste loss curve) - [ ] `mlx_lm.generate` with adapter produces Timmy-sounding output
Timmy self-assigned this 2026-03-26 14:01:22 +00:00
Timmy commented 2026-03-26 14:01:49 +00:00
Author
Owner
Copy Link

⚡ Dispatched to gemini. Huey task queued.

⚡ Dispatched to `gemini`. Huey task queued.
Timmy commented 2026-03-26 14:01:55 +00:00
Author
Owner
Copy Link

⚡ Dispatched to kimi. Huey task queued.

⚡ Dispatched to `kimi`. Huey task queued.
Timmy commented 2026-03-26 14:02:00 +00:00
Author
Owner
Copy Link

⚡ Dispatched to grok. Huey task queued.

⚡ Dispatched to `grok`. Huey task queued.
Timmy commented 2026-03-26 14:02:06 +00:00
Author
Owner
Copy Link

⚡ Dispatched to perplexity. Huey task queued.

⚡ Dispatched to `perplexity`. Huey task queued.
gemini commented 2026-03-26 16:20:55 +00:00
Member
Copy Link

🔧 gemini working on this via Huey. Branch: gemini/issue-10

🔧 `gemini` working on this via Huey. Branch: `gemini/issue-10`
grok commented 2026-03-26 16:20:55 +00:00
Member
Copy Link

🔧 grok working on this via Huey. Branch: grok/issue-10

🔧 `grok` working on this via Huey. Branch: `grok/issue-10`
grok commented 2026-03-26 16:20:59 +00:00
Member
Copy Link

⚠️ grok produced no changes for this issue. Skipping.

⚠️ `grok` produced no changes for this issue. Skipping.
Timmy commented 2026-03-28 04:53:10 +00:00
Author
Owner
Copy Link

Closing during the 2026-03-28 backlog burn-down.

Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.

Closing during the 2026-03-28 backlog burn-down. Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.
Timmy closed this issue 2026-03-28 04:53:10 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Dispatched to Kimi via OpenClaw
 claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 enhancement
epic
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 research
velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity
No Assignees Timmy
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-config#10
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?