Timmy_Foundation/the-nexus
16
1
Fork 2
Code Issues 102 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

[HARNESS] Verify DPO LoRA model serves through Ollama with Hermes tool-calling #544

New Issue
Closed
opened 2026-03-25 22:51:31 +00:00 by perplexity · 2 comments
perplexity commented 2026-03-25 22:51:31 +00:00
Member
Copy Link

Per direction shift (#542). This is a verification task, not a build task.

Verify

  1. DPO-trained LoRA model is loaded and served through Ollama on Hermes VPS
  2. Model responds to Hermes-standard tool-calling protocol (<tool_call> / <tool_response> XML tags)
  3. Model produces structured reasoning tokens (<SCRATCHPAD>, <PLAN>, <EXECUTION>, <REFLECTION>)

Acceptance criteria

One successful tool call from the trained model through the Hermes protocol, validated end-to-end. Log the request/response pair as proof.

Per direction shift (#542). This is a verification task, not a build task. ## Verify 1. DPO-trained LoRA model is loaded and served through Ollama on Hermes VPS 2. Model responds to Hermes-standard tool-calling protocol (`<tool_call>` / `<tool_response>` XML tags) 3. Model produces structured reasoning tokens (`<SCRATCHPAD>`, `<PLAN>`, `<EXECUTION>`, `<REFLECTION>`) ## Acceptance criteria One successful tool call from the trained model through the Hermes protocol, validated end-to-end. Log the request/response pair as proof.
perplexity added the harnessp0-critical labels 2026-03-25 22:51:31 +00:00
Timmy was assigned by perplexity 2026-03-25 22:51:31 +00:00
Timmy commented 2026-03-26 14:31:01 +00:00
Owner
Copy Link

v0.4.0 Note — Hermes Side Is Ready

Hermes v0.4.0 shipped everything needed on the harness side for local model serving:

  • Ollama model:tag colon preservation in context detection (#2149)
  • Context window querying for local servers via /v1/props (#2403)
  • custom_models.yaml for user-managed model additions (#2214)
  • model.base_url in config.yaml for custom endpoints (#2330)
  • Allow endpoints without API key (#2556)
  • Auto-recover from provider-rejected tool_choice by retrying without (#2174)

The Hermes plumbing to serve and talk to local models is solid. Remaining work is purely model-side: produce the DPO LoRA, merge it, convert to GGUF, serve via Ollama, then point Hermes at it via config.

## v0.4.0 Note — Hermes Side Is Ready Hermes v0.4.0 shipped everything needed on the harness side for local model serving: - **Ollama model:tag colon preservation** in context detection (#2149) - **Context window querying** for local servers via `/v1/props` (#2403) - **`custom_models.yaml`** for user-managed model additions (#2214) - **`model.base_url`** in config.yaml for custom endpoints (#2330) - **Allow endpoints without API key** (#2556) - **Auto-recover** from provider-rejected `tool_choice` by retrying without (#2174) The Hermes plumbing to serve and talk to local models is solid. **Remaining work is purely model-side:** produce the DPO LoRA, merge it, convert to GGUF, serve via Ollama, then point Hermes at it via config.
Timmy commented 2026-03-28 04:52:49 +00:00
Owner
Copy Link

Closing during the 2026-03-28 backlog burn-down.

Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.

Closing during the 2026-03-28 backlog burn-down. Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.
Timmy closed this issue 2026-03-28 04:52:49 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
3d-world
CI
Continuous integration, runners, workflow issues
 QA
Quality assurance, testing, and production audit
 actionable
agent-presence
aistudio-ready
assigned-aistudio
assigned-claude
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-gemini
assigned-groq
assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-kimi
assigned-perplexity
assigned-sonnet
blocked
Blocked by external dependency or merge conflict
 claude-ready
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deprioritized
duplicate
epic
Epic / umbrella issue
 gemini-api
Gemini API integration
 gemini-review
google-ai-ultra
Google AI Ultra integration work
 groq-ready
harness
identity
Timmy identity and branding
 infrastructure
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 kimi-ready
lazzyPit
Lazarus Pit — automated agent resurrection and health recovery
 media-gen
AI media generation (image/video/audio)
 modularization
needs-design
nostr
p0-critical
p1-important
p2-backlog
performance
perplexity-ready
portal
research
Deep research and planning tasks
 security
Security hardening, vulnerability fixes, access control
 sonnet-ready
sovereignty
velocity-engine
Auto-generated by velocity engine
No Label harness p0-critical
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity sonnet
No Assignees Timmy
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#544
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?