Rockachopa/Timmy-time-dashboard
1
0
Fork 2
Code Issues 6 Pull Requests Actions Packages Projects Releases Wiki Activity

[P1] Build semantic index for research outputs (nomic-embed-text + SQLite) #976

New Issue
Closed
opened 2026-03-22 19:08:53 +00:00 by perplexity · 1 comment
perplexity commented 2026-03-22 19:08:53 +00:00
Collaborator
Copy Link

Parent

  • #972 — [GOVERNING] Replacing Claude — Autonomous Research Pipeline Spec

Objective

Index all research outputs into a semantic memory store so repeated questions are answered from local cache at zero API cost.

Scope

  • Embed research outputs using nomic-embed-text-v1.5 via Ollama (300MB model)
  • Store embeddings in SQLite or ChromaDB
  • Implement memory.search(topic, limit=10) with confidence scoring
  • Implement memory.store(topic, report, type="research")
  • Index existing research artifacts (the 6+ PDFs already triaged)

Key Design Notes

  • This is the foundation for Tier 4 (cached) in the cascade strategy
  • Target: 80%+ of research queries answered from local cache within 3 months
  • Same embedding model and store as the UESP RAG pipeline (#969) — consolidate

Effort Estimate

4 hours

Related

  • #969 — UESP RAG knowledge pipeline (same infrastructure)
  • #955 — PerceptionCache (similar pattern for game perception)
## Parent - #972 — [GOVERNING] Replacing Claude — Autonomous Research Pipeline Spec ## Objective Index all research outputs into a semantic memory store so repeated questions are answered from local cache at zero API cost. ## Scope - Embed research outputs using `nomic-embed-text-v1.5` via Ollama (300MB model) - Store embeddings in SQLite or ChromaDB - Implement `memory.search(topic, limit=10)` with confidence scoring - Implement `memory.store(topic, report, type="research")` - Index existing research artifacts (the 6+ PDFs already triaged) ## Key Design Notes - This is the foundation for Tier 4 (cached) in the cascade strategy - Target: 80%+ of research queries answered from local cache within 3 months - Same embedding model and store as the UESP RAG pipeline (#969) — consolidate ## Effort Estimate 4 hours ## Related - #969 — UESP RAG knowledge pipeline (same infrastructure) - #955 — PerceptionCache (similar pattern for game perception)
gemini was assigned by Rockachopa 2026-03-22 23:30:49 +00:00
gemini commented 2026-03-23 18:16:08 +00:00
Collaborator
Copy Link

Attempted to implement semantic index for research outputs using Ollama embeddings and SQLite. Modified src/config.py, src/timmy/memory/embeddings.py, and src/timmy/memory_system.py. Also created index_research_docs.py to demonstrate indexing. All tests passed locally after changes. I was unable to create a pull request due to policy restrictions.

Attempted to implement semantic index for research outputs using Ollama embeddings and SQLite. Modified `src/config.py`, `src/timmy/memory/embeddings.py`, and `src/timmy/memory_system.py`. Also created `index_research_docs.py` to demonstrate indexing. All tests passed locally after changes. I was unable to create a pull request due to policy restrictions.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
Workshop: Timmy as Presence (Epic #222)
 actionable
Has a concrete code/config task extracted
 assigned-claude
Issue currently assigned to Claude agent — do not assign to another agent
 assigned-gemini
Issue currently assigned to Gemini agent — do not assign to another agent
 assigned-groq
assigned-kimi
Issue currently assigned to Kimi agent — do not assign to another agent
 assigned-manus
Issue currently assigned to Manus agent — do not assign to another agent
 claude-ready
consolidation
Part of a consolidation epic
 deprioritized
Keep open but not blocking P0 work
 deprioritized
Keep open but not blocking P0 work
 duplicate
Duplicate of another issue
 gemini-review
Auto-generated by Gemini, needs relevance review
 groq-ready
harness
Core product: agent framework, heartbeat, inference, memory
 heartbeat
Harness: Agent heartbeat loop
 inference
Harness: Inference and model routing
 infrastructure
Supporting stage: dashboard, CI/CD, deployment, DNS
 kimi-ready
Scoped and ready for Kimi to pick up
 memory-session
Harness: Memory and session crystallization
 morrowind
Harness: Morrowind embodiment
 needs-design
Needs architectural design before implementation
 needs-extraction
Philosophy with unextracted engineering work
 p0-critical
Priority 0: Must fix now
 p1-important
Priority 1: Important, next sprint
 p2-backlog
Priority 2: Backlog, do when time permits
 philosophy
Philosophical foundation — informs architecture decisions
 rejected-direction
Closed: rejected or superseded direction
 seed:know-purpose
Three Seeds: KNOW YOUR PURPOSE
 seed:serve-real
Three Seeds: SERVE THE REAL
 seed:tell-truth
Three Seeds: TELL THE TRUTH
 sovereignty
Harness: Sovereignty stack
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Timmy claude grok groq kimi manus perplexity Rockachopa
No Assignees gemini
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#976
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?