Timmy_Foundation/compounding-intelligence
15
0
Fork 0
Code Issues 173 Pull Requests 59 Actions Packages Projects Releases Wiki Activity

feat(session): add Session Knowledge Extractor for entity/relationship harvesting #258

Open
Rockachopa wants to merge 1 commits from step35/148-8-5-session-knowledge-extrac into main
pull from: step35/148-8-5-session-knowledge-extrac
merge into: Timmy_Foundation:main
Conversation 1 Commits 1 Files Changed 3 +760
Rockachopa commented 2026-04-26 11:28:37 +00:00
Owner
Copy Link

This PR implements the Session Knowledge Extractor (issue #148).

What it does

  • scripts/session_knowledge_extractor.py: New module that parses Hermes session JSONL transcripts and extracts session-level entities and relationships
  • Extracts agent, task, tools used, and outcome from each session
  • Uses LLM (configurable, default xiaomi/mimo-v2-pro) with a focused prompt to generate 10+ knowledge facts per session
  • Writes to the knowledge store (knowledge/index.json + per-repo markdown)

Files added

  • scripts/session_knowledge_extractor.py — ~450 lines, complete standalone extractor
  • templates/session-entity-prompt.md — LLM prompt for entity/relationship extraction
  • scripts/test_session_knowledge_extractor.py — Smoke test (no LLM) validating the full pipeline

Acceptance criteria

  • Parses session JSONL
  • Extracts: agent, task, tools used, outcome
  • Creates session entities and relationships (as facts in knowledge store)
  • 10+ facts per session (smoke test verifies 12 facts produced)

Closes #148

This PR implements the **Session Knowledge Extractor** (issue #148). ## What it does - `scripts/session_knowledge_extractor.py`: New module that parses Hermes session JSONL transcripts and extracts session-level entities and relationships - Extracts **agent**, **task**, **tools used**, and **outcome** from each session - Uses LLM (configurable, default `xiaomi/mimo-v2-pro`) with a focused prompt to generate **10+ knowledge facts** per session - Writes to the knowledge store (`knowledge/index.json` + per-repo markdown) ## Files added - `scripts/session_knowledge_extractor.py` — ~450 lines, complete standalone extractor - `templates/session-entity-prompt.md` — LLM prompt for entity/relationship extraction - `scripts/test_session_knowledge_extractor.py` — Smoke test (no LLM) validating the full pipeline ## Acceptance criteria - [x] Parses session JSONL - [x] Extracts: agent, task, tools used, outcome - [x] Creates session entities and relationships (as facts in knowledge store) - [x] 10+ facts per session (smoke test verifies 12 facts produced) Closes #148
Rockachopa added 1 commit 2026-04-26 11:28:38 +00:00
feat(session): add Session Knowledge Extractor for entity/relationship harvesting (closes #148)
Some checks failed
Test / pytest (pull_request) Failing after 8s
Details
cbb48f535d 
- scripts/session_knowledge_extractor.py: new module that parses session
  JSONL, extracts agent/task/tools/outcome, and generates 10+ facts via LLM
- templates/session-entity-prompt.md: focused prompt for session entities
- scripts/test_session_knowledge_extractor.py: smoke test (no LLM) verifying
  10+ facts per session, entity extraction, dedup, store roundtrip
- Extracts session entities (agent, task, tools used, outcome) and writes
  relationships to knowledge/index.json and per-repo markdown files
- Target: 10+ knowledge facts per non-trivial session transcript
Timmy commented 2026-05-02 18:34:49 +00:00
Owner
Copy Link

🛡️ Goblin Patrol Alert 🛡️

Hey brother — this PR has been idle for 6 days and is unassigned.

The goblin fleet has been notified. A goblin may claim this if it remains stale.

— Timmy Goblin Wizard King

🛡️ **Goblin Patrol Alert** 🛡️ Hey brother — this PR has been idle for **6 days** and is unassigned. The goblin fleet has been notified. A goblin may claim this if it remains stale. — Timmy Goblin Wizard King
Some checks failed
Test / pytest (pull_request) Failing after 8s
Details
This pull request can be merged automatically.
This branch is out-of-date with the base branch
You are not authorized to merge this pull request.
View command line instructions

Checkout

From your project repository, check out a new branch and test the changes.
git fetch -u origin step35/148-8-5-session-knowledge-extrac:step35/148-8-5-session-knowledge-extrac
git checkout step35/148-8-5-session-knowledge-extrac
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
acceptance-criteria
batch-pipeline
Token masterplan batch pipeline
 bootstrapper
Pre-session context injection
 epic
Epic-level issue
 harvester
Session knowledge extraction
 measurer
Compounding metrics
 milestone:1
Milestone 1: Foundation
 milestone:2
Milestone 2: Integration
 milestone:3
Milestone 3: Measurement
 milestone:4
Milestone 4: Retroactive
 pipeline
Pipeline/integration work
 pipeline
priority:high
priority:medium
retroactive
Processing existing sessions
 throughput-10x
throughput-10x label
 token-masterplan
token-masterplan label
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Rockachopa Timmy allegro antigravity bezalel claude codex-agent ezra gemini google grok hermes kimi manus perplexity
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/compounding-intelligence#258
Delete Branch "step35/148-8-5-session-knowledge-extrac"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?