[triage-generated] [soul-gap] Make confidence visible to users, not just debug logs #250

Closed
opened 2026-03-15 18:41:25 +00:00 by hermes · 0 comments
Collaborator

Why

PR#232 wired estimate_confidence() into session.py but it only goes to logger.debug(). The user never sees it. SOUL.md requires: When I am uncertain, I must say so in proportion to my uncertainty. Debug-only logging is compliance theater.

What

Make confidence visible in Timmy responses when below threshold.

Files

  • src/timmy/session.py lines 109-114, 149-151, 188-190 (three chat paths)
  • src/timmy/confidence.py (already works)

Implementation

Append confidence indicator to response text when confidence < 0.7:
if confidence is not None and confidence < 0.7:
response_text += f"

[confidence: {confidence:.0%}]"

Three places (all in session.py): chat(), chat_stream(), chat_with_tools()

Acceptance criteria

  • When confidence < 0.7, user sees [confidence: XX%] in response
  • When confidence >= 0.7, no indicator shown
  • All three chat paths include the indicator
  • Existing confidence tests still pass
  • New test: test_low_confidence_visible in tests/timmy/test_session.py

Tags: [triage-generated] [bug] [soul-gap]

## Why PR#232 wired estimate_confidence() into session.py but it only goes to logger.debug(). The user never sees it. SOUL.md requires: When I am uncertain, I must say so in proportion to my uncertainty. Debug-only logging is compliance theater. ## What Make confidence visible in Timmy responses when below threshold. ## Files - src/timmy/session.py lines 109-114, 149-151, 188-190 (three chat paths) - src/timmy/confidence.py (already works) ## Implementation Append confidence indicator to response text when confidence < 0.7: if confidence is not None and confidence < 0.7: response_text += f" [confidence: {confidence:.0%}]" Three places (all in session.py): chat(), chat_stream(), chat_with_tools() ## Acceptance criteria - When confidence < 0.7, user sees [confidence: XX%] in response - When confidence >= 0.7, no indicator shown - All three chat paths include the indicator - Existing confidence tests still pass - New test: test_low_confidence_visible in tests/timmy/test_session.py Tags: [triage-generated] [bug] [soul-gap]
Sign in to join this conversation.
No Label
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#250