[DISCIPLINE] Make Hermes-local short sessions clean before tool use #97

Closed
opened 2026-03-29 23:58:27 +00:00 by Timmy · 2 comments
Owner

Context
The direct local mind is better than the Hermes-wrapped local agent.

Evidence:

  • ~/.timmy/test-results/local_decision_session_20260329_194101.md passed a short decision session
  • ~/.hermes/sessions/session_20260329_194141_be2c3a.json answered, but drifted into invented operational guidance
  • ~/.hermes/sessions/session_20260329_193422_8d243c.json failed grounded action entirely

We should not jump straight from "short chat works" to "full tool agent works".
The next frontier is disciplined Hermes-local short sessions.

Goal
Create a narrow Hermes-local session lane that produces clean, truthful, conservative short answers before attempting file/tool work.

Levers to test

  • shorter system framing
  • job-specific toolsets or no-tools lane
  • tighter prompt structure
  • context pruning / deterministic compaction
  • lower-temperature local defaults where appropriate

Acceptance criteria

  • a reproducible Hermes-local short-session test exists
  • the lane answers at least 5 conservative decision questions without inventing commands, config keys, or world state
  • proof session files are saved and linked in the PR
  • failure mode from session_20260329_194141_be2c3a.json is no longer reproduced in the new lane
  • docs explain when to use this discipline lane versus the harder grounded-action lane

PR proof required

  • merged PR with the new lane plus before/after evidence
Context The direct local mind is better than the Hermes-wrapped local agent. Evidence: - `~/.timmy/test-results/local_decision_session_20260329_194101.md` passed a short decision session - `~/.hermes/sessions/session_20260329_194141_be2c3a.json` answered, but drifted into invented operational guidance - `~/.hermes/sessions/session_20260329_193422_8d243c.json` failed grounded action entirely We should not jump straight from "short chat works" to "full tool agent works". The next frontier is disciplined Hermes-local short sessions. Goal Create a narrow Hermes-local session lane that produces clean, truthful, conservative short answers before attempting file/tool work. Levers to test - shorter system framing - job-specific toolsets or no-tools lane - tighter prompt structure - context pruning / deterministic compaction - lower-temperature local defaults where appropriate Acceptance criteria - a reproducible Hermes-local short-session test exists - the lane answers at least 5 conservative decision questions without inventing commands, config keys, or world state - proof session files are saved and linked in the PR - failure mode from `session_20260329_194141_be2c3a.json` is no longer reproduced in the new lane - docs explain when to use this discipline lane versus the harder grounded-action lane PR proof required - merged PR with the new lane plus before/after evidence
Timmy self-assigned this 2026-03-29 23:58:27 +00:00
Author
Owner

Uniwizard context: Clean sessions before tool use feeds into grammar-constrained generation (#91 timmy-home) and prompt tier routing (#88).

Uniwizard context: Clean sessions before tool use feeds into grammar-constrained generation (#91 timmy-home) and prompt tier routing (#88).
Author
Owner

Absorbed into timmy-home #91 (grammar-constrained generation) and #88 (prompt routing tiers). Closing.

Absorbed into timmy-home #91 (grammar-constrained generation) and #88 (prompt routing tiers). Closing.
Timmy closed this issue 2026-03-30 16:49:52 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-config#97