Timmy_Foundation/compounding-intelligence
15
0
Fork 0
Code Issues 173 Pull Requests 59 Actions Packages Projects Releases Wiki Activity

feat: Quality gate — score and filter knowledge entries #198

New Issue
Closed
opened 2026-04-15 15:18:06 +00:00 by Rockachopa · 0 comments
Rockachopa commented 2026-04-15 15:18:06 +00:00
Owner
Copy Link

Epic: #136 (Knowledge Pipeline v2)

Task

Score each knowledge entry on quality and filter low-value entries.

Quality Dimensions

  • Specificity: concrete examples vs vague generalities
  • Actionability: can this be used to do something?
  • Freshness: is this still accurate?
  • Source quality: was the model/provider reliable?

Scoring

def quality_score(entry: KnowledgeEntry) -> float:
    specificity = score_specificity(entry.content)
    actionability = score_actionability(entry.content)
    freshness = score_freshness(entry.provenance.timestamp)
    source_quality = SOURCE_QUALITY_MAP[entry.provenance.model]
    
    return 0.3*specificity + 0.3*actionability + 0.2*freshness + 0.2*source_quality

Deliverables

  • Quality scorer: compounding-intelligence/quality_gate.py
  • Threshold: entries scoring < 0.5 are filtered out
  • Report: quality distribution of harvested knowledge
  • Integration with training data pipeline

Labels: quality, filtering, priority:high

## Epic: #136 (Knowledge Pipeline v2) ### Task Score each knowledge entry on quality and filter low-value entries. ### Quality Dimensions - **Specificity**: concrete examples vs vague generalities - **Actionability**: can this be used to do something? - **Freshness**: is this still accurate? - **Source quality**: was the model/provider reliable? ### Scoring ```python def quality_score(entry: KnowledgeEntry) -> float: specificity = score_specificity(entry.content) actionability = score_actionability(entry.content) freshness = score_freshness(entry.provenance.timestamp) source_quality = SOURCE_QUALITY_MAP[entry.provenance.model] return 0.3*specificity + 0.3*actionability + 0.2*freshness + 0.2*source_quality ``` ### Deliverables - [ ] Quality scorer: `compounding-intelligence/quality_gate.py` - [ ] Threshold: entries scoring < 0.5 are filtered out - [ ] Report: quality distribution of harvested knowledge - [ ] Integration with training data pipeline ### Labels: quality, filtering, priority:high
hermes was assigned by Rockachopa 2026-04-15 16:23:29 +00:00
hermes was unassigned by Rockachopa 2026-04-17 05:06:16 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acceptance-criteria
batch-pipeline
Token masterplan batch pipeline
 bootstrapper
Pre-session context injection
 epic
Epic-level issue
 harvester
Session knowledge extraction
 measurer
Compounding metrics
 milestone:1
Milestone 1: Foundation
 milestone:2
Milestone 2: Integration
 milestone:3
Milestone 3: Measurement
 milestone:4
Milestone 4: Retroactive
 pipeline
Pipeline/integration work
 pipeline
priority:high
priority:medium
retroactive
Processing existing sessions
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude codex-agent ezra gemini google grok hermes kimi manus perplexity
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/compounding-intelligence#198
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?