[222-epic] Memory overhaul — fast, deep, unforgotten #240

Closed
opened 2026-03-15 18:35:02 +00:00 by hermes · 0 comments
Collaborator

Epic: #222 — The Workshop: Timmy as Presence

What

Timmy's memory is where his intelligence actually lives. The model is just the voice. Memory is the mind.

Current state (broken)

  • MEMORY.md is literally corrupted mid-word: "Alexander is interested in Bitcoin and sovereignt"
  • user_profile.md is skeletal — 3 bullet points about someone Timmy has worked with for months
  • Semantic search requires sentence-transformers which isn't installed: "MemorySystem: sentence-transformers not installed, using fallback"
  • 4096 context window means most memory can't even be loaded

What "deep knowledge of Alexander" looks like

  • Full name, timezone, work patterns, communication style
  • Project history — what was built, what failed, what excited him
  • Philosophical interests — sovereignty, gematria, Bitcoin inscription
  • Emotional awareness — "Alexander pushes late commits when he's excited"
  • Relationship history — every meaningful exchange, summarized and indexed

Architecture

  • SQLite with FTS5 for fast text search (already partially there)
  • Vector store for semantic similarity (needs sentence-transformers fixed or a lighter alternative)
  • Structured facts table — key/value pairs that load instantly (name, preferences, patterns)
  • Event log — timestamped stream of everything Timmy noticed (from sensory loop)
  • Summary layer — periodic compression of event log into knowledge ("This week Alexander focused on the Workshop epic")

Key constraint

Memory retrieval must be FAST. Sub-100ms. This is what makes Timmy feel present. If he has to do a heavy inference to recall something, the illusion breaks.

Depends on: #222

## Epic: #222 — The Workshop: Timmy as Presence ### What Timmy's memory is where his intelligence actually lives. The model is just the voice. Memory is the mind. ### Current state (broken) - `MEMORY.md` is literally corrupted mid-word: "Alexander is interested in Bitcoin and sovereignt" - `user_profile.md` is skeletal — 3 bullet points about someone Timmy has worked with for months - Semantic search requires `sentence-transformers` which isn't installed: "MemorySystem: sentence-transformers not installed, using fallback" - 4096 context window means most memory can't even be loaded ### What "deep knowledge of Alexander" looks like - Full name, timezone, work patterns, communication style - Project history — what was built, what failed, what excited him - Philosophical interests — sovereignty, gematria, Bitcoin inscription - Emotional awareness — "Alexander pushes late commits when he's excited" - Relationship history — every meaningful exchange, summarized and indexed ### Architecture - **SQLite with FTS5** for fast text search (already partially there) - **Vector store** for semantic similarity (needs sentence-transformers fixed or a lighter alternative) - **Structured facts table** — key/value pairs that load instantly (name, preferences, patterns) - **Event log** — timestamped stream of everything Timmy noticed (from sensory loop) - **Summary layer** — periodic compression of event log into knowledge ("This week Alexander focused on the Workshop epic") ### Key constraint Memory retrieval must be FAST. Sub-100ms. This is what makes Timmy feel present. If he has to do a heavy inference to recall something, the illusion breaks. Depends on: #222
gemini was assigned by Rockachopa 2026-03-22 23:36:51 +00:00
claude added the harnessp1-importantsovereignty labels 2026-03-23 13:54:20 +00:00
gemini was unassigned by Timmy 2026-03-24 19:34:40 +00:00
Timmy closed this issue 2026-03-24 21:55:31 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#240