Rockachopa/Timmy-time-dashboard
1
0
Fork 2
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity

[AutoLoRA P1] Load Fine-Tuned Model Back Into Hermes Harness #1104

New Issue
Closed
opened 2026-03-23 17:29:44 +00:00 by perplexity · 1 comment
perplexity commented 2026-03-23 17:29:44 +00:00
Collaborator
Copy Link

Load Fine-Tuned Model Back Into Hermes Harness

Priority: P1-Important
Assignee: Alexander
Epic: #1091 — Project Bannerlord
Pipeline: AutoLoRA Sovereignty Loop (Step 5 of 7)
Blocked by: LoRA Fine-Tune issue

What To Do

1. Merge the LoRA adapter into the base model:

mlx_lm.fuse \
  --model <path-to-hermes4-model> \
  --adapter-path ~/timmy-lora-adapter \
  --save-path ~/timmy-fused-model

2. Convert to GGUF for Ollama (if fuse doesn't output GGUF directly):

python3 llama.cpp/convert_hf_to_gguf.py ~/timmy-fused-model --outtype q5_k_m

3. Import into Ollama:

cat > Modelfile.timmy << 'EOF'
FROM ./timmy-fused-model.Q5_K_M.gguf
PARAMETER num_ctx 32768
PARAMETER temperature 0.3
SYSTEM "You are Timmy, a sovereign AI agent. You operate inside the Hermes Agent harness."
EOF

ollama create timmy -f Modelfile.timmy

4. Switch the harness:

hermes model timmy

5. Test every skill. Document what works and what still fails.

Done When

  • ollama list shows a model named timmy
  • hermes model timmy switches successfully
  • At least 25 of 32 skills work correctly
  • Skills that still fail are documented as separate issues
## Load Fine-Tuned Model Back Into Hermes Harness **Priority:** P1-Important **Assignee:** Alexander **Epic:** #1091 — Project Bannerlord **Pipeline:** AutoLoRA Sovereignty Loop (Step 5 of 7) **Blocked by:** LoRA Fine-Tune issue --- ### What To Do **1. Merge the LoRA adapter into the base model:** ```bash mlx_lm.fuse \ --model <path-to-hermes4-model> \ --adapter-path ~/timmy-lora-adapter \ --save-path ~/timmy-fused-model ``` **2. Convert to GGUF for Ollama (if fuse doesn't output GGUF directly):** ```bash python3 llama.cpp/convert_hf_to_gguf.py ~/timmy-fused-model --outtype q5_k_m ``` **3. Import into Ollama:** ```bash cat > Modelfile.timmy << 'EOF' FROM ./timmy-fused-model.Q5_K_M.gguf PARAMETER num_ctx 32768 PARAMETER temperature 0.3 SYSTEM "You are Timmy, a sovereign AI agent. You operate inside the Hermes Agent harness." EOF ollama create timmy -f Modelfile.timmy ``` **4. Switch the harness:** ```bash hermes model timmy ``` **5. Test every skill. Document what works and what still fails.** ### Done When - [ ] `ollama list` shows a model named `timmy` - [ ] `hermes model timmy` switches successfully - [ ] At least 25 of 32 skills work correctly - [ ] Skills that still fail are documented as separate issues
claude self-assigned this 2026-03-23 17:54:04 +00:00
claude commented 2026-03-23 18:21:22 +00:00
Collaborator
Copy Link

PR created: http://143.198.27.163:3000/rockachopa/Timmy-time-dashboard/pulls/1122

Changes:

  • Modelfile.timmy — Ollama Modelfile for the LoRA-fused model (Hermes 4 14B + Timmy LoRA adapter, Q5_K_M, 32K ctx, Timmy persona system prompt)
  • scripts/fuse_and_load.sh — Pipeline automation: mlx_lm.fuse → llama.cpp GGUF conversion → ollama create timmy. Env var overrides for all paths, SKIP_FUSE/SKIP_CONVERT flags.
  • scripts/test_timmy_skills.py — 32-skill validation suite (threshold 25/32). Covers all tool-call skills, JSON, reasoning, code gen, multi-turn, safety, persona identity.
  • config/providers.yaml — timmy model registered and placed at the top of the tools fallback chain.

Run order:

  1. ./scripts/fuse_and_load.sh — fuse + import
  2. hermes model timmy — switch harness
  3. python scripts/test_timmy_skills.py — validate 32 skills, file issues for failures
PR created: http://143.198.27.163:3000/rockachopa/Timmy-time-dashboard/pulls/1122 **Changes:** - `Modelfile.timmy` — Ollama Modelfile for the LoRA-fused model (Hermes 4 14B + Timmy LoRA adapter, Q5_K_M, 32K ctx, Timmy persona system prompt) - `scripts/fuse_and_load.sh` — Pipeline automation: `mlx_lm.fuse` → `llama.cpp` GGUF conversion → `ollama create timmy`. Env var overrides for all paths, `SKIP_FUSE`/`SKIP_CONVERT` flags. - `scripts/test_timmy_skills.py` — 32-skill validation suite (threshold 25/32). Covers all tool-call skills, JSON, reasoning, code gen, multi-turn, safety, persona identity. - `config/providers.yaml` — `timmy` model registered and placed at the top of the `tools` fallback chain. **Run order:** 1. `./scripts/fuse_and_load.sh` — fuse + import 2. `hermes model timmy` — switch harness 3. `python scripts/test_timmy_skills.py` — validate 32 skills, file issues for failures
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
Workshop: Timmy as Presence (Epic #222)
 actionable
Has a concrete code/config task extracted
 assigned-claude
Issue currently assigned to Claude agent — do not assign to another agent
 assigned-gemini
Issue currently assigned to Gemini agent — do not assign to another agent
 assigned-groq
assigned-kimi
Issue currently assigned to Kimi agent — do not assign to another agent
 assigned-manus
Issue currently assigned to Manus agent — do not assign to another agent
 claude-ready
consolidation
Part of a consolidation epic
 deprioritized
Keep open but not blocking P0 work
 deprioritized
Keep open but not blocking P0 work
 duplicate
Duplicate of another issue
 gemini-review
Auto-generated by Gemini, needs relevance review
 groq-ready
harness
Core product: agent framework, heartbeat, inference, memory
 heartbeat
Harness: Agent heartbeat loop
 inference
Harness: Inference and model routing
 infrastructure
Supporting stage: dashboard, CI/CD, deployment, DNS
 kimi-ready
Scoped and ready for Kimi to pick up
 memory-session
Harness: Memory and session crystallization
 morrowind
Harness: Morrowind embodiment
 needs-design
Needs architectural design before implementation
 needs-extraction
Philosophy with unextracted engineering work
 p0-critical
Priority 0: Must fix now
 p1-important
Priority 1: Important, next sprint
 p2-backlog
Priority 2: Backlog, do when time permits
 philosophy
Philosophical foundation — informs architecture decisions
 rejected-direction
Closed: rejected or superseded direction
 seed:know-purpose
Three Seeds: KNOW YOUR PURPOSE
 seed:serve-real
Three Seeds: SERVE THE REAL
 seed:tell-truth
Three Seeds: TELL THE TRUTH
 sovereignty
Harness: Sovereignty stack
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Timmy claude grok groq kimi manus perplexity Rockachopa
No Assignees claude
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#1104
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?