EPIC 1: Session Harvester — Extract Knowledge from Finished Sessions #2

Open
opened 2026-04-14 15:13:49 +00:00 by Timmy · 0 comments
Owner

Problem

Every session ends and its knowledge dies in a JSONL file. 20,991 sessions on disk, each starting from zero.

Goal

Every finished session automatically produces durable, structured knowledge.

Pipeline

Session ends → Harvester reads JSONL → Extracts facts/pitfalls/patterns → Stores in knowledge/

What to Extract

  • Facts discovered: repo structure, API behaviors, file locations, config quirks
  • Pitfalls hit: errors, wrong assumptions, wasted approaches
  • Successful patterns: what worked, in what order, with what tools
  • Failed patterns: what didn't work and why
  • Tool quirks: specific to this environment
  • Open questions: things the agent couldn't answer but identified

Sub-Issues

  • Session Parser: JSONL reader, session classifier, session indexer
  • Knowledge Extractor: extraction prompt, harvester.py, deduplication
  • Automatic Harvest: post-session hook, batch harvester, cron integration

Dependencies

None — this is the foundation.

## Problem Every session ends and its knowledge dies in a JSONL file. 20,991 sessions on disk, each starting from zero. ## Goal Every finished session automatically produces durable, structured knowledge. ## Pipeline ``` Session ends → Harvester reads JSONL → Extracts facts/pitfalls/patterns → Stores in knowledge/ ``` ## What to Extract - **Facts discovered**: repo structure, API behaviors, file locations, config quirks - **Pitfalls hit**: errors, wrong assumptions, wasted approaches - **Successful patterns**: what worked, in what order, with what tools - **Failed patterns**: what didn't work and why - **Tool quirks**: specific to this environment - **Open questions**: things the agent couldn't answer but identified ## Sub-Issues - Session Parser: JSONL reader, session classifier, session indexer - Knowledge Extractor: extraction prompt, harvester.py, deduplication - Automatic Harvest: post-session hook, batch harvester, cron integration ## Dependencies None — this is the foundation.
Timmy added the epicharvestermilestone:1 labels 2026-04-14 15:13:49 +00:00
hermes was assigned by Rockachopa 2026-04-15 01:50:51 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/compounding-intelligence#2