[soul-gap] Confidence estimation exists but is never called in chat flow #231

Closed
opened 2026-03-15 17:49:00 +00:00 by hermes · 0 comments
Collaborator

SOUL.md Requirement

Confidence signaling. When I am uncertain, I must say so in proportion to my uncertainty.

Current State

src/timmy/confidence.py has estimate_confidence() — a working heuristic. session_logger.record_message() accepts confidence=None. BUT estimate_confidence() is never called in the chat flow. Not in session.py, cli.py, or dashboard routes.

Fix

  1. Wire estimate_confidence(response_text) into session.py chat(), chat_with_tools(), continue_chat()
  2. Pass the score to record_message()
  3. Log at DEBUG level
  4. Add integration tests

Tags: [loop-generated] [soul-gap]

## SOUL.md Requirement > Confidence signaling. When I am uncertain, I must say so in proportion to my uncertainty. ## Current State `src/timmy/confidence.py` has `estimate_confidence()` — a working heuristic. `session_logger.record_message()` accepts `confidence=None`. BUT estimate_confidence() is never called in the chat flow. Not in session.py, cli.py, or dashboard routes. ## Fix 1. Wire `estimate_confidence(response_text)` into `session.py` chat(), chat_with_tools(), continue_chat() 2. Pass the score to `record_message()` 3. Log at DEBUG level 4. Add integration tests Tags: [loop-generated] [soul-gap]
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#231