Edge intelligence — browser model + silent Nostr signing #15
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Run a small model in the browser for instant responses.
Migrated from: replit/timmy-tower#65
PR created: http://143.198.27.163:3000/Timmy_Foundation/the-nexus/pulls/27
What was built:
edge-intelligence.js— In-browser LLM inference (WebLLM/WebGPU → Transformers.js/CPU → Ollama). Lazy-activates via a HUD button so nothing downloads until the user opts in.nostr-identity.js— Silent Nostr signing. Generates a keypair on first visit stored inlocalStorage; signs NIP-01 events without any extension popup. Supports key import/rotation and optional NIP-07 delegation.Attempted to implement edge intelligence and silent Nostr signing as per the issue. Local changes are committed, but I am unable to push the branch
gemini/issue-15or create a pull request due to "User permission denied for writing" errors from Gitea. Please check my Gitea token permissions or the repository settings.Further attempts to push the branch
gemini/issue-15have failed due to connectivity issues (Failed to connect to 143.198.27.163 port 3000). The changes are committed locally, but I am unable to push them or create a pull request. Manual intervention is required to push the changes and create the PR.PR #27 is already open with the complete implementation: http://143.198.27.163:3000/Timmy_Foundation/the-nexus/pulls/27
Confirmed implementation covers all requirements:
edge-intelligence.js— WebLLM (WebGPU) → Transformers.js (WASM/CPU) → Ollama fallback chain. Lazy-loaded via HUD button, nothing downloads until user opts in.nostr-identity.js— Silent Nostr keypair generation/persistence in localStorage, NIP-01 event signing, key import, optional NIP-07 delegation. Zero extension popup.app.js— Chat pipeline updated to try edge model first, then Ollama, with animated thinking indicator.index.html+style.css— Edge AI status badge (idle/loading/ready/fallback) and Nostr npub badge in HUD.Complements, does not replace, the Ollama backend.
🤖 Build Order #11/13 — See #36 for the full sequential build plan.\n\nStatus: BLOCKED by #14. Wait for #14 to be merged before starting.\nBranch:
claude/issue-15[Manus Feedback] Edge intelligence via WebLLM is great for responsiveness. Feedback: This should be treated as a 'UI-level reflex' for instant feedback (e.g., UI animations or simple greetings) while the heavier Ollama backend handles the deep logic. Ensure the browser model doesn't block the main Three.js render loop.
[Manus Feedback] Edge intelligence via WebLLM is great for responsiveness. Feedback: This should be treated as a 'UI-level reflex' for instant feedback (e.g., UI animations or simple greetings) while the heavier Ollama backend handles the deep logic. Ensure the browser model doesn't block the main Three.js render loop.
[Manus Deep Insight] Deep Insight: Edge Intelligence is about 'Low-Latency Reflexes'. Insight: Use the browser model to handle 'Pre-emptive Actions'. For example, as a user walks toward the Morrowind portal, the browser model can pre-fetch relevant metadata or even start the WebSocket handshake for the OpenMW bridge. This 'Predictive Loading' powered by a local-first AI makes the Nexus feel incredibly responsive and 'alive'.
[Manus Deep Insight] Deep Insight: Edge Intelligence is about 'Low-Latency Reflexes'. Insight: Use the browser model to handle 'Pre-emptive Actions'. For example, as a user walks toward the Morrowind portal, the browser model can pre-fetch relevant metadata or even start the WebSocket handshake for the OpenMW bridge. This 'Predictive Loading' powered by a local-first AI makes the Nexus feel incredibly responsive and 'alive'.
PR created: http://143.198.27.163:3000/Timmy_Foundation/the-nexus/pulls/59
What was built (based on current main at #46):
edge-intelligence.js— Lazy in-browser inference: WebLLM (SmolLM2-135M, WebGPU) → Ollama → null. Activated via HUD button; nothing downloads until user opts in. All inference is async — Three.js render loop never blocked.nostr-identity.js— Silent Nostr keypair generation (secp256k1/@noble) persisted in localStorage. Local Schnorr signing with no extension popup; NIP-07 extension preferred when present.app.js— Chat pipeline calls edgeQuery() first, shows animated thinking cursor, falls back to canned responses. Nostr identity inits at startup and shows npub in HUD.index.html+style.css— Sovereignty bar: Edge AI status button + Nostr npub badge.Closed per direction shift (#542). Reason: Edge intelligence / browser model — superseded by Hermes harness + cascade router.
The Nexus has three jobs: Heartbeat, Harness, Portal Interface. This issue doesn't serve any of them.