Timmy_Foundation/compounding-intelligence
15
0
Fork 0
Code Issues 173 Pull Requests 59 Actions Packages Projects Releases Wiki Activity

Knowledge Mine: Worker 02 — Sessions 1000-2000 #33

New Issue
Open
opened 2026-04-14 18:43:57 +00:00 by Timmy · 0 comments
Timmy commented 2026-04-14 18:43:57 +00:00
Owner
Copy Link

Parallel Worker 2/20

Process sessions 1000 through 2000 from the session sampler.

Task

  1. Load session list from ~/.hermes/knowledge/session-scores.json
  2. Select sessions ranked 1000-2000 by value score
  3. For each session:
    • Read .jsonl transcript
    • Extract: decisions, patterns, errors, tool quirks, user preferences
    • Save to ~/.hermes/knowledge/sessions/{session_id}.json
  4. Report: sessions processed, tokens used, errors encountered

Script

python3 ~/.hermes/pipelines/knowledge-mine.py --worker 2 --range 1000-2000

Acceptance Criteria

  • All 1000 sessions processed
  • Each output is valid JSON with required fields
  • Token usage tracked and reported
  • Resume support (can restart from last processed)

Tokens: ~10M

Depends On: Knowledge Mine: Session Sampler (#23)

## Parallel Worker 2/20 Process sessions 1000 through 2000 from the session sampler. ### Task 1. Load session list from `~/.hermes/knowledge/session-scores.json` 2. Select sessions ranked 1000-2000 by value score 3. For each session: - Read .jsonl transcript - Extract: decisions, patterns, errors, tool quirks, user preferences - Save to `~/.hermes/knowledge/sessions/{session_id}.json` 4. Report: sessions processed, tokens used, errors encountered ### Script ```bash python3 ~/.hermes/pipelines/knowledge-mine.py --worker 2 --range 1000-2000 ``` ### Acceptance Criteria - [ ] All 1000 sessions processed - [ ] Each output is valid JSON with required fields - [ ] Token usage tracked and reported - [ ] Resume support (can restart from last processed) ### Tokens: ~10M ### Depends On: Knowledge Mine: Session Sampler (#23)
Timmy added the harvesterbatch-pipeline labels 2026-04-14 18:43:57 +00:00
hermes was assigned by Rockachopa 2026-04-15 01:50:29 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
acceptance-criteria
batch-pipeline
Token masterplan batch pipeline
 bootstrapper
Pre-session context injection
 epic
Epic-level issue
 harvester
Session knowledge extraction
 measurer
Compounding metrics
 milestone:1
Milestone 1: Foundation
 milestone:2
Milestone 2: Integration
 milestone:3
Milestone 3: Measurement
 milestone:4
Milestone 4: Retroactive
 pipeline
Pipeline/integration work
 pipeline
priority:high
priority:medium
retroactive
Processing existing sessions
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
No Label batch-pipeline harvester
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude codex-agent ezra gemini google grok hermes kimi manus perplexity
No Assignees hermes
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/compounding-intelligence#33
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?