Timmy_Foundation/compounding-intelligence
15
0
Fork 0
Code Issues 173 Pull Requests 59 Actions Packages Projects Releases Wiki Activity

[Measure] Build knowledge validator and decay system #15

New Issue
Open
opened 2026-04-14 15:15:22 +00:00 by Timmy · 0 comments
Timmy commented 2026-04-14 15:15:22 +00:00
Owner
Copy Link

Epic: #4 (Compounding Measurement)

Task

Keep the knowledge store fresh. Facts go stale. Facts get contradicted.

Validator

  • Periodically check if stored facts are still true
  • High-confidence facts: check weekly
  • Low-confidence facts: check daily
  • Use a lightweight LLM call to verify against recent session data

Decay

  • If a fact hasn't been confirmed in N sessions, reduce confidence
  • Confidence below 0.3 → archive (don't delete, just don't inject)
  • Decay rate: -0.05 per week without confirmation

Contradiction Detection

  • When harvester extracts a fact that contradicts an existing one
  • Flag both for review
  • Higher-confidence source wins automatically
  • Log contradiction for metrics

Acceptance Criteria

  • Stale facts detected and decayed
  • Contradictions flagged and resolved
  • No false positives on facts that are just rare (not stale)
  • Validator runs as part of daily cron
## Epic: #4 (Compounding Measurement) ### Task Keep the knowledge store fresh. Facts go stale. Facts get contradicted. ### Validator - Periodically check if stored facts are still true - High-confidence facts: check weekly - Low-confidence facts: check daily - Use a lightweight LLM call to verify against recent session data ### Decay - If a fact hasn't been confirmed in N sessions, reduce confidence - Confidence below 0.3 → archive (don't delete, just don't inject) - Decay rate: -0.05 per week without confirmation ### Contradiction Detection - When harvester extracts a fact that contradicts an existing one - Flag both for review - Higher-confidence source wins automatically - Log contradiction for metrics ### Acceptance Criteria - [ ] Stale facts detected and decayed - [ ] Contradictions flagged and resolved - [ ] No false positives on facts that are just rare (not stale) - [ ] Validator runs as part of daily cron
Timmy added the measurermilestone:3 labels 2026-04-14 15:15:22 +00:00
hermes was assigned by Rockachopa 2026-04-15 01:50:38 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acceptance-criteria
batch-pipeline
Token masterplan batch pipeline
 bootstrapper
Pre-session context injection
 epic
Epic-level issue
 harvester
Session knowledge extraction
 measurer
Compounding metrics
 milestone:1
Milestone 1: Foundation
 milestone:2
Milestone 2: Integration
 milestone:3
Milestone 3: Measurement
 milestone:4
Milestone 4: Retroactive
 pipeline
Pipeline/integration work
 pipeline
priority:high
priority:medium
retroactive
Processing existing sessions
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
No Label measurer milestone:3
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude codex-agent ezra gemini google grok hermes kimi manus perplexity
No Assignees hermes
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/compounding-intelligence#15
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?