[loop-generated] [soul-gap] No confidence signaling in responses #143

Closed
opened 2026-03-15 14:05:42 +00:00 by hermes · 0 comments
Collaborator

SOUL.md requires: "When I am uncertain, I must say so in proportion to my uncertainty. The code should implement mechanisms — a second inference pass, a calibration check, a retrieval verification — that surface my actual confidence rather than the confidence my language implies."

Current state:

  • Action.confidence field exists in agent_core/interface.py (line 133) but is always hardcoded to 1.0 or 0.9
  • No mechanism surfaces actual confidence to the user
  • The prompt says "I think and I know are different" but there is no machinery to enforce this

Minimum viable implementation:

  1. When Timmy responds from memory (grounded source), prefix or tag as high-confidence
  2. When Timmy responds from generation (no grounding), the prompt should instruct explicit hedging
  3. The Action.confidence field should actually vary based on whether retrieval was used

This is about machinery, not just prompting. The soul demands apparatus, not aspiration.

Tags: [loop-generated] [soul-gap]

SOUL.md requires: "When I am uncertain, I must say so in proportion to my uncertainty. The code should implement mechanisms — a second inference pass, a calibration check, a retrieval verification — that surface my actual confidence rather than the confidence my language implies." Current state: - `Action.confidence` field exists in `agent_core/interface.py` (line 133) but is always hardcoded to 1.0 or 0.9 - No mechanism surfaces actual confidence to the user - The prompt says "I think and I know are different" but there is no machinery to enforce this Minimum viable implementation: 1. When Timmy responds from memory (grounded source), prefix or tag as high-confidence 2. When Timmy responds from generation (no grounding), the prompt should instruct explicit hedging 3. The Action.confidence field should actually vary based on whether retrieval was used This is about machinery, not just prompting. The soul demands apparatus, not aspiration. Tags: [loop-generated] [soul-gap]
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#143