[Memory P4] Automatic fact trust calibration from usage feedback #252

Open
opened 2026-04-09 00:41:56 +00:00 by Rockachopa · 0 comments
Owner

Context

fact_feedback tool exists (helpful/unhelpful) but is never called. Trust scores never change after initial assignment.

Task

  1. After prefetch injects facts and the turn completes:
    • If the conversation went well (no corrections), mark used facts as helpful
    • If the agent was corrected, mark the related fact as unhelpful
  2. Implement correction detection (user says "no", "wrong", "that's not right", "actually...")
  3. Trust scores drift over time: helpful facts rise, unhelpful facts sink
  4. Facts below min_trust threshold eventually get pruned

Acceptance Criteria

  • Facts used in successful interactions gain trust (+0.05 per helpful)
  • Facts that lead to corrections lose trust (-0.1 per unhelpful)
  • Trust changes are logged
  • Below-threshold facts are candidates for pruning

Part of: [EPIC] Unified Memory Architecture

## Context fact_feedback tool exists (helpful/unhelpful) but is never called. Trust scores never change after initial assignment. ## Task 1. After prefetch injects facts and the turn completes: - If the conversation went well (no corrections), mark used facts as helpful - If the agent was corrected, mark the related fact as unhelpful 2. Implement correction detection (user says "no", "wrong", "that's not right", "actually...") 3. Trust scores drift over time: helpful facts rise, unhelpful facts sink 4. Facts below min_trust threshold eventually get pruned ## Acceptance Criteria - Facts used in successful interactions gain trust (+0.05 per helpful) - Facts that lead to corrections lose trust (-0.1 per unhelpful) - Trust changes are logged - Below-threshold facts are candidates for pruning Part of: [EPIC] Unified Memory Architecture
Rockachopa added this to the Unified Memory Architecture milestone 2026-04-09 00:41:56 +00:00
Rockachopa added the phase:4-hygieneepic:memory labels 2026-04-09 00:41:56 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/hermes-agent#252