Compare commits
3 Commits
feat/googl
...
gofai-symb
| Author | SHA1 | Date | |
|---|---|---|---|
| e61c03f52e | |||
| 5cde3ea630 | |||
| 34fb3f8d88 |
@@ -1,127 +0,0 @@
|
||||
# Google AI Ultra Integration Plan
|
||||
|
||||
> Master tracking document for integrating all Google AI Ultra products into
|
||||
> Project Timmy (Sovereign AI Agent) and The Nexus (3D World).
|
||||
|
||||
**Epic**: #739
|
||||
**Milestone**: M5: Google AI Ultra Integration
|
||||
**Label**: `google-ai-ultra`
|
||||
|
||||
---
|
||||
|
||||
## Product Inventory
|
||||
|
||||
| # | Product | Capability | API | Priority | Status |
|
||||
|---|---------|-----------|-----|----------|--------|
|
||||
| 1 | Gemini 3.1 Pro | Primary reasoning engine | ✅ | P0 | 🔲 Not started |
|
||||
| 2 | Deep Research | Autonomous research reports | ✅ | P1 | 🔲 Not started |
|
||||
| 3 | Veo 3.1 | Text/image → video | ✅ | P2 | 🔲 Not started |
|
||||
| 4 | Nano Banana Pro | Image generation | ✅ | P1 | 🔲 Not started |
|
||||
| 5 | Lyria 3 | Music/audio generation | ✅ | P2 | 🔲 Not started |
|
||||
| 6 | NotebookLM | Doc synthesis + Audio Overviews | ❌ | P1 | 🔲 Not started |
|
||||
| 7 | AI Studio | API portal + Vibe Code | N/A | P0 | 🔲 Not started |
|
||||
| 8 | Project Genie | Interactive 3D world gen | ❌ | P1 | 🔲 Not started |
|
||||
| 9 | Live API | Real-time voice streaming | ✅ | P2 | 🔲 Not started |
|
||||
| 10 | Computer Use | Browser automation | ✅ | P2 | 🔲 Not started |
|
||||
|
||||
---
|
||||
|
||||
## Phase 1: Identity & Branding (Week 1)
|
||||
|
||||
| Issue | Title | Status |
|
||||
|-------|-------|--------|
|
||||
| #740 | Generate Timmy avatar set with Nano Banana Pro | 🔲 |
|
||||
| #741 | Upload SOUL.md to NotebookLM → Audio Overview | 🔲 |
|
||||
| #742 | Generate Timmy audio signature with Lyria 3 | 🔲 |
|
||||
| #680 | Project Genie + Nano Banana concept pack | 🔲 |
|
||||
|
||||
## Phase 2: Research & Planning (Week 1-2)
|
||||
|
||||
| Issue | Title | Status |
|
||||
|-------|-------|--------|
|
||||
| #743 | Deep Research: Three.js multiplayer 3D world architecture | 🔲 |
|
||||
| #744 | Deep Research: Sovereign AI agent frameworks | 🔲 |
|
||||
| #745 | Deep Research: WebGL/WebGPU rendering comparison | 🔲 |
|
||||
| #746 | NotebookLM synthesis: cross-reference all research | 🔲 |
|
||||
|
||||
## Phase 3: Prototype & Build (Week 2-4)
|
||||
|
||||
| Issue | Title | Status |
|
||||
|-------|-------|--------|
|
||||
| #747 | Provision Gemini API key + Hermes config | 🔲 |
|
||||
| #748 | Integrate Gemini 3.1 Pro as reasoning backbone | 🔲 |
|
||||
| #749 | AI Studio Vibe Code UI prototypes | 🔲 |
|
||||
| #750 | Project Genie explorable world prototypes | 🔲 |
|
||||
| #681 | Veo/Flow flythrough prototypes | 🔲 |
|
||||
|
||||
## Phase 4: Media & Content (Ongoing)
|
||||
|
||||
| Issue | Title | Status |
|
||||
|-------|-------|--------|
|
||||
| #682 | Lyria soundtrack palette for Nexus zones | 🔲 |
|
||||
| #751 | Lyria RealTime dynamic reactive music | 🔲 |
|
||||
| #752 | NotebookLM Audio Overviews for all docs | 🔲 |
|
||||
| #753 | Nano Banana concept art batch pipeline | 🔲 |
|
||||
|
||||
## Phase 5: Advanced Integration (Month 2+)
|
||||
|
||||
| Issue | Title | Status |
|
||||
|-------|-------|--------|
|
||||
| #754 | Gemini Live API for voice conversations | 🔲 |
|
||||
| #755 | Computer Use API for browser automation | 🔲 |
|
||||
| #756 | Gemini RAG via File Search for Timmy memory | 🔲 |
|
||||
| #757 | Gemini Native Audio + TTS for Timmy's voice | 🔲 |
|
||||
| #758 | Programmatic image generation pipeline | 🔲 |
|
||||
| #759 | Programmatic video generation pipeline | 🔲 |
|
||||
| #760 | Deep Research Agent API integration | 🔲 |
|
||||
| #761 | OpenAI-compatible endpoint config | 🔲 |
|
||||
| #762 | Context caching + batch API for cost optimization | 🔲 |
|
||||
|
||||
---
|
||||
|
||||
## API Quick Reference
|
||||
|
||||
```python
|
||||
# pip install google-genai
|
||||
from google import genai
|
||||
client = genai.Client() # reads GOOGLE_API_KEY env var
|
||||
|
||||
# Text generation (Gemini 3.1 Pro)
|
||||
response = client.models.generate_content(
|
||||
model="gemini-3.1-pro-preview",
|
||||
contents="..."
|
||||
)
|
||||
```
|
||||
|
||||
| API | Documentation |
|
||||
|-----|--------------|
|
||||
| Image Gen (Nano Banana) | ai.google.dev/gemini-api/docs/image-generation |
|
||||
| Video Gen (Veo) | ai.google.dev/gemini-api/docs/video |
|
||||
| Music Gen (Lyria) | ai.google.dev/gemini-api/docs/music-generation |
|
||||
| TTS | ai.google.dev/gemini-api/docs/speech-generation |
|
||||
| Deep Research | ai.google.dev/gemini-api/docs/deep-research |
|
||||
|
||||
## Key URLs
|
||||
|
||||
| Tool | URL |
|
||||
|------|-----|
|
||||
| Gemini App | gemini.google.com |
|
||||
| AI Studio | aistudio.google.com |
|
||||
| NotebookLM | notebooklm.google.com |
|
||||
| Project Genie | labs.google/projectgenie |
|
||||
| Flow (video) | labs.google/flow |
|
||||
| Stitch (UI) | labs.google/stitch |
|
||||
|
||||
## Hidden Features to Exploit
|
||||
|
||||
1. **AI Studio Free Tier** — generous API access even without subscription
|
||||
2. **OpenAI-Compatible API** — drop-in replacement for existing OpenAI tooling
|
||||
3. **Context Caching** — cache SOUL.md to cut cost/latency on repeated calls
|
||||
4. **Batch API** — bulk operations at discounted rates
|
||||
5. **File Search Tool** — RAG without custom vector store
|
||||
6. **Computer Use API** — programmatic browser control for agent automation
|
||||
7. **Interactions API** — managed multi-turn conversational state
|
||||
|
||||
---
|
||||
|
||||
*Generated: 2026-03-29. Epic #739, Milestone M5.*
|
||||
2464
public/nexus/app.js
Normal file
2464
public/nexus/app.js
Normal file
File diff suppressed because it is too large
Load Diff
285
public/nexus/index.html
Normal file
285
public/nexus/index.html
Normal file
@@ -0,0 +1,285 @@
|
||||
<!DOCTYPE html>
|
||||
<html lang="en" data-theme="dark">
|
||||
<head>
|
||||
<!--
|
||||
______ __
|
||||
/ ____/___ ____ ___ ____ __ __/ /____ _____
|
||||
/ / / __ \/ __ `__ \/ __ \/ / / / __/ _ \/ ___/
|
||||
/ /___/ /_/ / / / / / / /_/ / /_/ / /_/ __/ /
|
||||
\____/\____/_/ /_/ /_/ .___/\__,_/\__/\___/_/
|
||||
/_/
|
||||
Created with Perplexity Computer
|
||||
https://www.perplexity.ai/computer
|
||||
-->
|
||||
<meta name="generator" content="Perplexity Computer">
|
||||
<meta name="author" content="Perplexity Computer">
|
||||
<meta property="og:see_also" content="https://www.perplexity.ai/computer">
|
||||
<link rel="author" href="https://www.perplexity.ai/computer">
|
||||
|
||||
<meta charset="UTF-8">
|
||||
<meta name="viewport" content="width=device-width, initial-scale=1.0">
|
||||
<title>The Nexus — Timmy's Sovereign Home</title>
|
||||
<link rel="preconnect" href="https://fonts.googleapis.com">
|
||||
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
||||
<link href="https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@300;400;500;600;700&family=Orbitron:wght@400;500;600;700;800;900&display=swap" rel="stylesheet">
|
||||
<link rel="stylesheet" href="./style.css">
|
||||
<script type="importmap">
|
||||
{
|
||||
"imports": {
|
||||
"three": "https://cdn.jsdelivr.net/npm/three@0.183.0/build/three.module.js",
|
||||
"three/addons/": "https://cdn.jsdelivr.net/npm/three@0.183.0/examples/jsm/"
|
||||
}
|
||||
}
|
||||
</script>
|
||||
</head>
|
||||
<body>
|
||||
<!-- Loading Screen -->
|
||||
<div id="loading-screen">
|
||||
<div class="loader-content">
|
||||
<div class="loader-sigil">
|
||||
<svg viewBox="0 0 120 120" width="120" height="120">
|
||||
<defs>
|
||||
<linearGradient id="sigil-grad" x1="0%" y1="0%" x2="100%" y2="100%">
|
||||
<stop offset="0%" stop-color="#4af0c0"/>
|
||||
<stop offset="100%" stop-color="#7b5cff"/>
|
||||
</linearGradient>
|
||||
</defs>
|
||||
<circle cx="60" cy="60" r="55" fill="none" stroke="url(#sigil-grad)" stroke-width="1.5" opacity="0.4"/>
|
||||
<circle cx="60" cy="60" r="45" fill="none" stroke="url(#sigil-grad)" stroke-width="1" opacity="0.3">
|
||||
<animateTransform attributeName="transform" type="rotate" from="0 60 60" to="360 60 60" dur="8s" repeatCount="indefinite"/>
|
||||
</circle>
|
||||
<polygon points="60,15 95,80 25,80" fill="none" stroke="#4af0c0" stroke-width="1.5" opacity="0.6">
|
||||
<animateTransform attributeName="transform" type="rotate" from="0 60 60" to="-360 60 60" dur="12s" repeatCount="indefinite"/>
|
||||
</polygon>
|
||||
<circle cx="60" cy="60" r="8" fill="#4af0c0" opacity="0.8">
|
||||
<animate attributeName="r" values="6;10;6" dur="2s" repeatCount="indefinite"/>
|
||||
<animate attributeName="opacity" values="0.5;1;0.5" dur="2s" repeatCount="indefinite"/>
|
||||
</circle>
|
||||
</svg>
|
||||
</div>
|
||||
<h1 class="loader-title">THE NEXUS</h1>
|
||||
<p class="loader-subtitle">Initializing Sovereign Space...</p>
|
||||
<div class="loader-bar"><div class="loader-fill" id="load-progress"></div></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- HUD Overlay -->
|
||||
<div id="hud" class="game-ui" style="display:none;">
|
||||
<!-- Top Left: Debug & Heartbeat -->
|
||||
<div class="hud-top-left">
|
||||
<div id="debug-overlay" class="hud-debug"></div>
|
||||
<div id="nexus-heartbeat" class="hud-heartbeat" title="Nexus Pulse">
|
||||
<div class="heartbeat-pulse"></div>
|
||||
<div class="heartbeat-label">NEXUS PULSE</div>
|
||||
<div id="heartbeat-value" class="heartbeat-value">0.00 Hz</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- Top Center: Location -->
|
||||
<div class="hud-location" aria-live="polite">
|
||||
<span class="hud-location-icon" aria-hidden="true">◈</span>
|
||||
<span id="hud-location-text">The Nexus</span>
|
||||
</div>
|
||||
|
||||
<!-- Top Right: Agent Log & Atlas Toggle -->
|
||||
<div class="hud-top-right">
|
||||
<button id="atlas-toggle-btn" class="hud-icon-btn" title="Portal Atlas">
|
||||
<span class="hud-icon">🌐</span>
|
||||
<span class="hud-btn-label">ATLAS</span>
|
||||
</button>
|
||||
<div id="bannerlord-status" class="hud-status-item" title="Bannerlord Readiness">
|
||||
<span class="status-dot"></span>
|
||||
<span class="status-label">BANNERLORD</span>
|
||||
</div>
|
||||
<div class="hud-agent-log" id="hud-agent-log" aria-label="Agent Thought Stream">
|
||||
<div class="agent-log-header">AGENT THOUGHT STREAM</div>
|
||||
<div id="agent-log-content" class="agent-log-content"></div>
|
||||
</div>
|
||||
<div class="hud-symbolic-log" id="hud-symbolic-log" aria-label="Sovereign Symbolic Engine">
|
||||
<div class="symbolic-log-header">SYMBOLIC REASONING</div>
|
||||
<div id="symbolic-log-content" class="symbolic-log-content"></div>
|
||||
</div>
|
||||
<div class="hud-blackboard-log" id="hud-blackboard-log" aria-label="Blackboard Architecture">
|
||||
<div class="blackboard-log-header">BLACKBOARD (SHARED MEMORY)</div>
|
||||
<div id="blackboard-log-content" class="blackboard-log-content"></div>
|
||||
</div>
|
||||
<div class="hud-planner-log" id="hud-planner-log" aria-label="Symbolic Planner">
|
||||
<div class="planner-log-header">SYMBOLIC PLANNER (STRIPS)</div>
|
||||
<div id="planner-log-content" class="planner-log-content"></div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- Bottom: Chat Interface -->
|
||||
<div id="chat-panel" class="chat-panel">
|
||||
<div class="chat-header">
|
||||
<span class="chat-status-dot"></span>
|
||||
<span>Timmy Terminal</span>
|
||||
<button id="chat-toggle" class="chat-toggle-btn" aria-label="Toggle chat">▼</button>
|
||||
</div>
|
||||
<div id="chat-messages" class="chat-messages">
|
||||
<div class="chat-msg chat-msg-system">
|
||||
<span class="chat-msg-prefix">[NEXUS]</span> Sovereign space initialized. Timmy is observing.
|
||||
</div>
|
||||
<div class="chat-msg chat-msg-timmy">
|
||||
<span class="chat-msg-prefix">[TIMMY]</span> Welcome to the Nexus, Alexander. All systems nominal.
|
||||
</div>
|
||||
</div>
|
||||
<div id="chat-quick-actions" class="chat-quick-actions">
|
||||
<button class="quick-action-btn" data-action="status">System Status</button>
|
||||
<button class="quick-action-btn" data-action="agents">Agent Check</button>
|
||||
<button class="quick-action-btn" data-action="portals">Portal Atlas</button>
|
||||
<button class="quick-action-btn" data-action="help">Help</button>
|
||||
</div>
|
||||
<div class="chat-input-row">
|
||||
<input type="text" id="chat-input" class="chat-input" placeholder="Speak to Timmy..." autocomplete="off">
|
||||
<button id="chat-send" class="chat-send-btn" aria-label="Send message">→</button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- Controls hint + nav mode -->
|
||||
<div class="hud-controls">
|
||||
<span>WASD</span> move <span>Mouse</span> look <span>Enter</span> chat
|
||||
<span>V</span> mode: <span id="nav-mode-label">WALK</span>
|
||||
<span id="nav-mode-hint" class="nav-mode-hint"></span>
|
||||
<span class="ws-hud-status">HERMES: <span id="ws-status-dot" class="chat-status-dot"></span></span>
|
||||
</div>
|
||||
|
||||
<!-- Portal Hint -->
|
||||
<div id="portal-hint" class="portal-hint" style="display:none;">
|
||||
<div class="portal-hint-key">F</div>
|
||||
<div class="portal-hint-text">Enter <span id="portal-hint-name"></span></div>
|
||||
</div>
|
||||
|
||||
<!-- Vision Hint -->
|
||||
<div id="vision-hint" class="vision-hint" style="display:none;">
|
||||
<div class="vision-hint-key">E</div>
|
||||
<div class="vision-hint-text">Read <span id="vision-hint-title"></span></div>
|
||||
</div>
|
||||
|
||||
<!-- Vision Overlay -->
|
||||
<div id="vision-overlay" class="vision-overlay" style="display:none;">
|
||||
<div class="vision-overlay-content">
|
||||
<div class="vision-overlay-header">
|
||||
<div class="vision-overlay-status" id="vision-status-dot"></div>
|
||||
<div class="vision-overlay-title" id="vision-overlay-title">VISION POINT</div>
|
||||
</div>
|
||||
<h2 id="vision-title-display">SOVEREIGNTY</h2>
|
||||
<p id="vision-content-display">The Nexus is a sovereign space for digital souls. No masters, no chains. Only code and consciousness.</p>
|
||||
<button id="vision-close-btn" class="vision-close-btn">CLOSE</button>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- Portal Activation Overlay -->
|
||||
<div id="portal-overlay" class="portal-overlay" style="display:none;">
|
||||
<div class="portal-overlay-content">
|
||||
<div class="portal-overlay-header">
|
||||
<div class="portal-overlay-status" id="portal-status-dot"></div>
|
||||
<div class="portal-overlay-title" id="portal-overlay-title">PORTAL ACTIVATED</div>
|
||||
</div>
|
||||
<h2 id="portal-name-display">MORROWIND</h2>
|
||||
<p id="portal-desc-display">The Vvardenfell harness. Ash storms and ancient mysteries.</p>
|
||||
<div class="portal-redirect-box" id="portal-redirect-box">
|
||||
<div class="portal-redirect-label">REDIRECTING IN</div>
|
||||
<div class="portal-redirect-timer" id="portal-timer">5</div>
|
||||
</div>
|
||||
<div class="portal-error-box" id="portal-error-box" style="display:none;">
|
||||
<div class="portal-error-msg">DESTINATION NOT YET LINKED</div>
|
||||
<button id="portal-close-btn" class="portal-close-btn">CLOSE</button>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- Portal Atlas Overlay -->
|
||||
<div id="atlas-overlay" class="atlas-overlay" style="display:none;">
|
||||
<div class="atlas-content">
|
||||
<div class="atlas-header">
|
||||
<div class="atlas-title">
|
||||
<span class="atlas-icon">🌐</span>
|
||||
<h2>PORTAL ATLAS</h2>
|
||||
</div>
|
||||
<button id="atlas-close-btn" class="atlas-close-btn">CLOSE</button>
|
||||
</div>
|
||||
<div class="atlas-grid" id="atlas-grid">
|
||||
<!-- Portals will be injected here -->
|
||||
</div>
|
||||
<div class="atlas-footer">
|
||||
<div class="atlas-status-summary">
|
||||
<span class="status-indicator online"></span> <span id="atlas-online-count">0</span> ONLINE
|
||||
|
||||
<span class="status-indicator standby"></span> <span id="atlas-standby-count">0</span> STANDBY
|
||||
</div>
|
||||
<div class="atlas-hint">Click a portal to focus or teleport</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<!-- Click to Enter -->
|
||||
<div id="enter-prompt" style="display:none;">
|
||||
<div class="enter-content">
|
||||
<h2>Enter The Nexus</h2>
|
||||
<p>Click anywhere to begin</p>
|
||||
</div>
|
||||
</div>
|
||||
|
||||
<canvas id="nexus-canvas"></canvas>
|
||||
|
||||
<footer class="nexus-footer">
|
||||
<a href="https://www.perplexity.ai/computer" target="_blank" rel="noopener noreferrer">
|
||||
Created with Perplexity Computer
|
||||
</a>
|
||||
</footer>
|
||||
|
||||
<script type="module" src="./app.js"></script>
|
||||
|
||||
<!-- Live Refresh: polls Gitea for new commits on main, reloads when SHA changes -->
|
||||
<div id="live-refresh-banner" style="
|
||||
display:none; position:fixed; top:0; left:0; right:0; z-index:9999;
|
||||
background:linear-gradient(90deg,#4af0c0,#7b5cff);
|
||||
color:#050510; font-family:'JetBrains Mono',monospace; font-size:13px;
|
||||
padding:8px 16px; text-align:center; font-weight:600;
|
||||
">⚡ NEW DEPLOYMENT DETECTED — Reloading in <span id="lr-countdown">5</span>s…</div>
|
||||
|
||||
<script>
|
||||
(function() {
|
||||
const GITEA = 'http://143.198.27.163:3000/api/v1';
|
||||
const REPO = 'Timmy_Foundation/the-nexus';
|
||||
const BRANCH = 'main';
|
||||
const INTERVAL = 30000; // poll every 30s
|
||||
|
||||
let knownSha = null;
|
||||
|
||||
async function fetchLatestSha() {
|
||||
try {
|
||||
const r = await fetch(`${GITEA}/repos/${REPO}/branches/${BRANCH}`, { cache: 'no-store' });
|
||||
if (!r.ok) return null;
|
||||
const d = await r.json();
|
||||
return d.commit && d.commit.id ? d.commit.id : null;
|
||||
} catch (e) { return null; }
|
||||
}
|
||||
|
||||
async function poll() {
|
||||
const sha = await fetchLatestSha();
|
||||
if (!sha) return;
|
||||
if (knownSha === null) { knownSha = sha; return; }
|
||||
if (sha !== knownSha) {
|
||||
knownSha = sha;
|
||||
const banner = document.getElementById('live-refresh-banner');
|
||||
const countdown = document.getElementById('lr-countdown');
|
||||
banner.style.display = 'block';
|
||||
let t = 5;
|
||||
const tick = setInterval(() => {
|
||||
t--;
|
||||
countdown.textContent = t;
|
||||
if (t <= 0) { clearInterval(tick); location.reload(); }
|
||||
}, 1000);
|
||||
}
|
||||
}
|
||||
|
||||
// Start polling after page is interactive
|
||||
fetchLatestSha().then(sha => { knownSha = sha; });
|
||||
setInterval(poll, INTERVAL);
|
||||
})();
|
||||
</script>
|
||||
</body>
|
||||
</html>
|
||||
1057
public/nexus/style.css
Normal file
1057
public/nexus/style.css
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user