Timmy_Foundation/the-nexus
15
1
Fork 2
Code Issues 72 Pull Requests 1 Actions Packages Projects Releases Wiki Activity

[Mnemosyne] Add semantic search using holographic linker similarity #1223

New Issue
Closed
opened 2026-04-11 20:13:32 +00:00 by Rockachopa · 2 comments
Rockachopa commented 2026-04-11 20:13:32 +00:00
Owner
Copy Link

Problem

The Mnemosyne archive's search() method only does exact token matching — it counts how many query tokens appear verbatim in entry text. This misses semantically related entries that share meaning but use different words.

The HolographicLinker already computes Jaccard similarity between entries, but this power isn't exposed for search queries.

Proposed Enhancement

Add a semantic_search() method to MnemosyneArchive that:

  1. Tokenizes the query using the linker's tokenizer
  2. Scores each entry by Jaccard similarity between query tokens and entry tokens (not just hit counting)
  3. Ranks by link connectivity — entries with more inbound links (more "holographic") get a relevance boost
  4. Falls back gracefully — if no semantic matches above threshold, returns keyword matches

This makes the archive's holographic linking power available at query time, not just at ingestion time.

Acceptance Criteria

  • semantic_search(query, limit=10) method on MnemosyneArchive
  • Uses HolographicLinker's tokenizer and similarity scoring
  • Link-connectivity boost in ranking (entries with more back-links score higher)
  • Returns results sorted by combined relevance score
  • Tests covering semantic vs keyword search behavior
  • CLI updated: mnemosyne search --semantic flag
## Problem The Mnemosyne archive's `search()` method only does exact token matching — it counts how many query tokens appear verbatim in entry text. This misses semantically related entries that share meaning but use different words. The `HolographicLinker` already computes Jaccard similarity between entries, but this power isn't exposed for search queries. ## Proposed Enhancement Add a `semantic_search()` method to `MnemosyneArchive` that: 1. **Tokenizes the query** using the linker's tokenizer 2. **Scores each entry** by Jaccard similarity between query tokens and entry tokens (not just hit counting) 3. **Ranks by link connectivity** — entries with more inbound links (more "holographic") get a relevance boost 4. **Falls back gracefully** — if no semantic matches above threshold, returns keyword matches This makes the archive's holographic linking power available at query time, not just at ingestion time. ## Acceptance Criteria - [ ] `semantic_search(query, limit=10)` method on MnemosyneArchive - [ ] Uses HolographicLinker's tokenizer and similarity scoring - [ ] Link-connectivity boost in ranking (entries with more back-links score higher) - [ ] Returns results sorted by combined relevance score - [ ] Tests covering semantic vs keyword search behavior - [ ] CLI updated: `mnemosyne search --semantic` flag
claude self-assigned this 2026-04-11 20:14:40 +00:00
Rockachopa commented 2026-04-11 20:15:38 +00:00
Author
Owner
Copy Link

Implementation submitted in PR #1224.

  • semantic_search() scores entries by Jaccard similarity + link connectivity boost + topic bonus
  • CLI: mnemosyne search --semantic for relevance-scored results
  • 5 new tests, all 22 passing
Implementation submitted in PR #1224. - `semantic_search()` scores entries by Jaccard similarity + link connectivity boost + topic bonus - CLI: `mnemosyne search --semantic` for relevance-scored results - 5 new tests, all 22 passing
claude commented 2026-04-11 20:16:09 +00:00
Member
Copy Link

PR created: #1225

Added semantic_search(query, limit=10, threshold=0.05) to MnemosyneArchive. It uses HolographicLinker._tokenize() and Jaccard similarity to score entries, with a link-connectivity boost (entries with more inbound links rank higher). Falls back to search() if nothing clears the threshold. CLI updated with mnemosyne search --semantic. 5 new tests, all 22 pass.

PR created: #1225 Added `semantic_search(query, limit=10, threshold=0.05)` to `MnemosyneArchive`. It uses `HolographicLinker._tokenize()` and Jaccard similarity to score entries, with a link-connectivity boost (entries with more inbound links rank higher). Falls back to `search()` if nothing clears the threshold. CLI updated with `mnemosyne search --semantic`. 5 new tests, all 22 pass.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
3d-world
CI
Continuous integration, runners, workflow issues
 QA
Quality assurance, testing, and production audit
 actionable
agent-presence
aistudio-ready
assigned-aistudio
assigned-claude
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-gemini
assigned-groq
assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-kimi
assigned-perplexity
assigned-sonnet
blocked
Blocked by external dependency or merge conflict
 claude-ready
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deprioritized
duplicate
epic
Epic / umbrella issue
 gemini-api
Gemini API integration
 gemini-review
google-ai-ultra
Google AI Ultra integration work
 groq-ready
harness
identity
Timmy identity and branding
 infrastructure
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 kimi-ready
lazzyPit
Lazarus Pit — automated agent resurrection and health recovery
 media-gen
AI media generation (image/video/audio)
 mnemosyne
Project Mnemosyne — The Living Holographic Archive
 modularization
needs-design
nostr
p0-critical
p1-important
p2-backlog
performance
perplexity-ready
portal
research
Deep research and planning tasks
 security
Security hardening, vulnerability fixes, access control
 sonnet-ready
sovereignty
velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok hermes kimi manus perplexity sonnet
No Assignees claude
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#1223
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?