[HARNESS] Create Ollama Modelfile for Hermes 4 14B with Timmy system prompt #564

Closed
opened 2026-03-26 12:24:25 +00:00 by Timmy · 9 comments
Owner

Context

We are pulling bartowski/NousResearch_Hermes-4-14B-GGUF (Q4_K_M). It needs an Ollama Modelfile.

Task

  1. Read the existing hermes4:36b Modelfile for reference: ollama show hermes4:36b --modelfile
  2. Read SOUL.md from the repo for the system prompt
  3. Create a Modelfile at models/Modelfile.hermes4-14b that:
    • FROM points to ~/models/hermes4-14b/NousResearch_Hermes-4-14B-Q4_K_M.gguf
    • Uses ChatML template (im_start/im_end)
    • Sets num_ctx 8192
    • Includes condensed Timmy system prompt from SOUL.md
  4. Commit to timmy-config repo

Acceptance criteria

  • Modelfile exists in timmy-config/models/
  • ollama create hermes4:14b -f succeeds after GGUF download
  • ollama run hermes4:14b Who are you returns a Timmy-sounding response
## Context We are pulling bartowski/NousResearch_Hermes-4-14B-GGUF (Q4_K_M). It needs an Ollama Modelfile. ## Task 1. Read the existing hermes4:36b Modelfile for reference: `ollama show hermes4:36b --modelfile` 2. Read SOUL.md from the repo for the system prompt 3. Create a Modelfile at models/Modelfile.hermes4-14b that: - FROM points to ~/models/hermes4-14b/NousResearch_Hermes-4-14B-Q4_K_M.gguf - Uses ChatML template (im_start/im_end) - Sets num_ctx 8192 - Includes condensed Timmy system prompt from SOUL.md 4. Commit to timmy-config repo ## Acceptance criteria - [ ] Modelfile exists in timmy-config/models/ - [ ] ollama create hermes4:14b -f <modelfile> succeeds after GGUF download - [ ] ollama run hermes4:14b Who are you returns a Timmy-sounding response
grok was assigned by Timmy 2026-03-26 12:24:25 +00:00
Author
Owner

Dispatched to claude. Huey task queued.

⚡ Dispatched to `claude`. Huey task queued.
Author
Owner

Dispatched to gemini. Huey task queued.

⚡ Dispatched to `gemini`. Huey task queued.
Author
Owner

Dispatched to kimi. Huey task queued.

⚡ Dispatched to `kimi`. Huey task queued.
Author
Owner

Dispatched to grok. Huey task queued.

⚡ Dispatched to `grok`. Huey task queued.
Author
Owner

Dispatched to perplexity. Huey task queued.

⚡ Dispatched to `perplexity`. Huey task queued.
Member

🔧 grok working on this via Huey. Branch: grok/issue-564

🔧 `grok` working on this via Huey. Branch: `grok/issue-564`
Member

⚠️ grok produced no changes for this issue. Skipping.

⚠️ `grok` produced no changes for this issue. Skipping.
Author
Owner

v0.4.0 Note — Hermes Side Is Ready

Same as #544 — Hermes v0.4.0 now handles local Ollama models cleanly:

  • Preserves model:tag colons (#2149)
  • Queries /v1/props for actual context window (#2403)
  • Supports custom_models.yaml for model registration (#2214)
  • Supports model.base_url in config (#2330)
  • Works without API keys (#2556)

Still need to do: Create the actual Modelfile with Timmy system prompt and chat template. But the Hermes config integration is handled — just add the model to custom_models.yaml after creating it.

## v0.4.0 Note — Hermes Side Is Ready Same as #544 — Hermes v0.4.0 now handles local Ollama models cleanly: - Preserves `model:tag` colons (#2149) - Queries `/v1/props` for actual context window (#2403) - Supports `custom_models.yaml` for model registration (#2214) - Supports `model.base_url` in config (#2330) - Works without API keys (#2556) **Still need to do:** Create the actual Modelfile with Timmy system prompt and chat template. But the Hermes config integration is handled — just add the model to `custom_models.yaml` after creating it.
Author
Owner

Closing during the 2026-03-28 backlog burn-down.

Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.

Closing during the 2026-03-28 backlog burn-down. Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.
Timmy closed this issue 2026-03-28 04:52:43 +00:00
Sign in to join this conversation.
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#564