feat: add fleet cost report for #520

GENOME.md

@@ -1,144 +1,209 @@
-# GENOME.md — Timmy_Foundation/timmy-home
-
-Generated by `pipelines/codebase_genome.py`.
+# GENOME.md — the-nexus
 
 ## Project Overview
 
-Timmy Foundation's home repository for development operations and configurations.
+`the-nexus` is a hybrid repo that combines three layers in one codebase:
 
-- Text files indexed: 3181
-- Source and script files: 231
-- Test files: 95
-- Documentation files: 755
+1. A browser-facing world shell rooted in `index.html`, `boot.js`, `bootstrap.mjs`, `app.js`, `style.css`, `portals.json`, `vision.json`, `manifest.json`, and `gofai_worker.js`
+2. A Python realtime bridge centered on `server.py` plus harness code under `nexus/`
+3. A memory / fleet / operator layer spanning `mempalace/`, `mcp_servers/`, `multi_user_bridge.py`, and supporting scripts
 
-## Architecture
+The repo is not a clean single-purpose frontend and not just a backend harness. It is a mixed world/runtime/ops repository where browser rendering, WebSocket telemetry, MCP-driven game harnesses, and fleet memory tooling coexist.
+
+Grounded repo facts from this checkout:
+- Browser shell files exist at repo root: `index.html`, `app.js`, `style.css`, `manifest.json`, `gofai_worker.js`
+- Data/config files also live at repo root: `portals.json`, `vision.json`
+- Realtime bridge exists in `server.py`
+- Game harnesses exist in `nexus/morrowind_harness.py` and `nexus/bannerlord_harness.py`
+- Memory/fleet sync exists in `mempalace/tunnel_sync.py`
+- Desktop/game automation MCP servers exist in `mcp_servers/desktop_control_server.py` and `mcp_servers/steam_info_server.py`
+- Validation exists in `tests/test_browser_smoke.py`, `tests/test_portals_json.py`, `tests/test_index_html_integrity.py`, and `tests/test_repo_truth.py`
+
+The current architecture is best understood as a sovereign world shell plus operator/game harness backend, with accumulated documentation drift from multiple restoration and migration efforts.
+
+## Architecture Diagram
 
 ```mermaid
 graph TD
-  repo_root["repo"]
-  angband["angband"]
-  ansible["ansible"]
-  briefings["briefings"]
-  codebase_genome["codebase_genome"]
-  config["config"]
-  configs["configs"]
-  conftest["conftest"]
-  dns_records["dns-records"]
-  evennia["evennia"]
-  evennia_tools["evennia_tools"]
-  repo_root --> angband
-  repo_root --> ansible
-  repo_root --> briefings
-  repo_root --> codebase_genome
-  repo_root --> config
-  repo_root --> configs
+    browser[Index HTML Shell\nindex.html -> boot.js -> bootstrap.mjs -> app.js]
+    assets[Root Assets\nstyle.css\nmanifest.json\ngofai_worker.js]
+    data[World Data\nportals.json\nvision.json]
+    ws[Realtime Bridge\nserver.py\nWebSocket broadcast hub]
+    gofai[In-browser GOFAI\nSymbolicEngine\nNeuroSymbolicBridge\nsetupGOFAI/updateGOFAI]
+    harnesses[Python Harnesses\nnexus/morrowind_harness.py\nnexus/bannerlord_harness.py]
+    mcp[MCP Adapters\nmcp_servers/desktop_control_server.py\nmcp_servers/steam_info_server.py]
+    memory[Memory + Fleet\nmempalace/tunnel_sync.py\nmempalace.js]
+    bridge[Operator / MUD Bridge\nmulti_user_bridge.py\ncommands/timmy_commands.py]
+    tests[Verification\ntests/test_browser_smoke.py\ntests/test_portals_json.py\ntests/test_repo_truth.py]
+    docs[Contracts + Drift Docs\nBROWSER_CONTRACT.md\nREADME.md\nCLAUDE.md\nINVESTIGATION_ISSUE_1145.md]
+
+    browser --> assets
+    browser --> data
+    browser --> gofai
+    browser --> ws
+    harnesses --> mcp
+    harnesses --> ws
+    bridge --> ws
+    memory --> ws
+    tests --> browser
+    tests --> data
+    tests --> docs
+    docs --> browser
 ```
 
-## Entry Points
+## Entry Points and Data Flow
 
-- `codebase_genome.py` — python main guard (`python3 codebase_genome.py`)
-- `gemini-fallback-setup.sh` — operational script (`bash gemini-fallback-setup.sh`)
-- `morrowind/hud.sh` — operational script (`bash morrowind/hud.sh`)
-- `pipelines/codebase_genome.py` — python main guard (`python3 pipelines/codebase_genome.py`)
-- `scripts/agent_pr_gate.py` — operational script (`python3 scripts/agent_pr_gate.py`)
-- `scripts/audit_trail.py` — operational script (`python3 scripts/audit_trail.py`)
-- `scripts/auto_restart_agent.sh` — operational script (`bash scripts/auto_restart_agent.sh`)
-- `scripts/autonomous_issue_creator.py` — operational script (`python3 scripts/autonomous_issue_creator.py`)
-- `scripts/backlog_cleanup.py` — operational script (`python3 scripts/backlog_cleanup.py`)
-- `scripts/backlog_triage.py` — operational script (`python3 scripts/backlog_triage.py`)
-- `scripts/backlog_triage_cron.sh` — operational script (`bash scripts/backlog_triage_cron.sh`)
-- `scripts/backup_pipeline.sh` — operational script (`bash scripts/backup_pipeline.sh`)
+### Primary entry points
 
-## Data Flow
+- `index.html` — root browser entry point
+- `boot.js` — startup selector; `tests/boot.test.js` shows it chooses file-mode vs HTTP/module-mode and injects `bootstrap.mjs` when served over HTTP
+- `bootstrap.mjs` — module bootstrap for the browser shell
+- `app.js` — main browser runtime; owns world state, GOFAI wiring, metrics polling, and portal/UI logic
+- `server.py` — WebSocket broadcast bridge on `ws://0.0.0.0:8765`
+- `nexus/morrowind_harness.py` — GamePortal/MCP harness for OpenMW Morrowind
+- `nexus/bannerlord_harness.py` — GamePortal/MCP harness for Bannerlord
+- `mempalace/tunnel_sync.py` — pulls remote fleet closets into the local palace over HTTP
+- `multi_user_bridge.py` — HTTP bridge for multi-user chat/session integration
+- `mcp_servers/desktop_control_server.py` — stdio MCP server exposing screenshots/mouse/keyboard control
 
-1. Operators enter through `codebase_genome.py`, `gemini-fallback-setup.sh`, `morrowind/hud.sh`.
-2. Core logic fans into top-level components: `angband`, `ansible`, `briefings`, `codebase_genome`, `config`, `configs`.
-3. Validation is incomplete around `wizards/allegro/home/skills/red-teaming/godmode/scripts/auto_jailbreak.py`, `timmy-local/cache/agent_cache.py`, `wizards/allegro/home/skills/red-teaming/godmode/scripts/parseltongue.py`, so changes there carry regression risk.
-4. Final artifacts land as repository files, docs, or runtime side effects depending on the selected entry point.
+### Data flow
+
+1. Browser startup begins at `index.html`
+2. `boot.js` decides whether the page is being served correctly; in HTTP mode it injects `bootstrap.mjs`
+3. `bootstrap.mjs` hands off to `app.js`
+4. `app.js` loads world configuration from `portals.json` and `vision.json`
+5. `app.js` constructs the Three.js scene and in-browser reasoning components, including `SymbolicEngine`, `NeuroSymbolicBridge`, `setupGOFAI()`, and `updateGOFAI()`
+6. Browser state and external runtimes connect through `server.py`, which broadcasts messages between connected clients
+7. Python harnesses (`nexus/morrowind_harness.py`, `nexus/bannerlord_harness.py`) spawn MCP subprocesses for desktop control / Steam metadata, capture state, execute actions, and feed telemetry into the Nexus bridge
+8. Memory/fleet tools like `mempalace/tunnel_sync.py` import remote palace data into local closets, extending what the operator/runtime layers can inspect
+9. Tests validate both the static browser contract and the higher-level repo-truth/memory contracts
+
+### Important repo-specific runtime facts
+
+- `portals.json` is a JSON array of portal/world/operator entries; examples in this checkout include `morrowind`, `bannerlord`, `workshop`, `archive`, `chapel`, and `courtyard`
+- `server.py` is a plain broadcast hub: clients send messages, the server forwards them to other connected clients
+- `nexus/morrowind_harness.py` and `nexus/bannerlord_harness.py` both implement a GamePortal pattern with MCP subprocess clients over stdio and WebSocket telemetry uplink
+- `mempalace/tunnel_sync.py` is not speculative; it is a real client that discovers remote wings, searches remote rooms, and writes `.closet.json` payloads locally
 
 ## Key Abstractions
 
-- `codebase_genome.py` — classes `FunctionInfo`:19; functions `extract_functions()`:58, `generate_test()`:116, `scan_repo()`:191, `find_existing_tests()`:209, `main()`:231
-- `evennia/timmy_world/game.py` — classes `World`:91, `ActionSystem`:421, `TimmyAI`:539, `NPCAI`:550; functions `get_narrative_phase()`:55, `get_phase_transition_event()`:65
-- `evennia/timmy_world/world/game.py` — classes `World`:19, `ActionSystem`:326, `TimmyAI`:444, `NPCAI`:455; functions none detected
-- `timmy-world/game.py` — classes `World`:19, `ActionSystem`:349, `TimmyAI`:467, `NPCAI`:478; functions none detected
-- `wizards/allegro/home/skills/red-teaming/godmode/scripts/auto_jailbreak.py` — classes none detected; functions none detected
-- `uniwizard/self_grader.py` — classes `SessionGrade`:23, `WeeklyReport`:55, `SelfGrader`:74; functions `main()`:713
-- `uni-wizard/v3/intelligence_engine.py` — classes `ExecutionPattern`:27, `ModelPerformance`:44, `AdaptationEvent`:58, `PatternDatabase`:69; functions none detected
-- `scripts/know_thy_father/crossref_audit.py` — classes `ThemeCategory`:30, `Principle`:160, `MeaningKernel`:169, `CrossRefFinding`:178; functions `extract_themes_from_text()`:192, `parse_soul_md()`:206, `parse_kernels()`:264, `cross_reference()`:296, `generate_report()`:440, `main()`:561
+### Browser runtime
+
+- `app.js`
+  - Defines in-browser reasoning/state machinery, including `class SymbolicEngine`, `class NeuroSymbolicBridge`, `setupGOFAI()`, and `updateGOFAI()`
+  - Couples rendering, local symbolic reasoning, metrics polling, and portal/UI logic in one very large root module
+- `BROWSER_CONTRACT.md`
+  - Acts like an executable architecture contract for the browser surface
+  - Declares required files, DOM IDs, Three.js expectations, provenance rules, and WebSocket expectations
+
+### Realtime bridge
+
+- `server.py`
+  - Single hub abstraction: a WebSocket broadcast server maintaining a `clients` set and forwarding messages from one client to the others
+  - This is the seam between browser shell, harnesses, and external telemetry producers
+
+### GamePortal harness layer
+
+- `nexus/morrowind_harness.py`
+- `nexus/bannerlord_harness.py`
+  - Both define MCP client wrappers, `GameState` / `ActionResult`-style data classes, and an Observe-Decide-Act telemetry loop
+  - The harnesses are symmetric enough to be understood as reusable portal adapters with game-specific context injected on top
+
+### Memory / fleet layer
+
+- `mempalace/tunnel_sync.py`
+  - Encodes the fleet-memory sync client contract: discover wings, pull broad room queries, write closet files, support dry-run
+- `mempalace.js`
+  - Minimal browser/Electron bridge to MemPalace commands via `window.electronAPI.execPython(...)`
+  - Important because it shows a second memory integration surface distinct from the Python fleet sync path
+
+### Operator / interaction bridge
+
+- `multi_user_bridge.py`
+- `commands/timmy_commands.py`
+  - These bridge user-facing conversations or MUD/Evennia interactions back into Timmy/Nexus services
 
 ## API Surface
 
-- CLI: `python3 codebase_genome.py` — python main guard (`codebase_genome.py`)
-- CLI: `bash gemini-fallback-setup.sh` — operational script (`gemini-fallback-setup.sh`)
-- CLI: `bash morrowind/hud.sh` — operational script (`morrowind/hud.sh`)
-- CLI: `python3 pipelines/codebase_genome.py` — python main guard (`pipelines/codebase_genome.py`)
-- CLI: `python3 scripts/agent_pr_gate.py` — operational script (`scripts/agent_pr_gate.py`)
-- CLI: `python3 scripts/audit_trail.py` — operational script (`scripts/audit_trail.py`)
-- CLI: `bash scripts/auto_restart_agent.sh` — operational script (`scripts/auto_restart_agent.sh`)
-- CLI: `python3 scripts/autonomous_issue_creator.py` — operational script (`scripts/autonomous_issue_creator.py`)
-- Python: `extract_functions()` from `codebase_genome.py:58`
-- Python: `generate_test()` from `codebase_genome.py:116`
-- Python: `scan_repo()` from `codebase_genome.py:191`
-- Python: `find_existing_tests()` from `codebase_genome.py:209`
-- Python: `main()` from `codebase_genome.py:231`
-- Python: `get_narrative_phase()` from `evennia/timmy_world/game.py:55`
+### Browser / static surface
 
-## Test Coverage Report
+- `index.html` served over HTTP
+- `boot.js` exports `bootPage()`; verified by `node --test tests/boot.test.js`
+- Data APIs are file-based inside the repo: `portals.json`, `vision.json`, `manifest.json`
 
-- Source and script files inspected: 231
-- Test files inspected: 95
-- Coverage gaps:
-  - `wizards/allegro/home/skills/red-teaming/godmode/scripts/auto_jailbreak.py` — no matching test reference detected
-  - `timmy-local/cache/agent_cache.py` — no matching test reference detected
-  - `wizards/allegro/home/skills/red-teaming/godmode/scripts/parseltongue.py` — no matching test reference detected
-  - `wizards/allegro/home/skills/red-teaming/godmode/scripts/godmode_race.py` — no matching test reference detected
-  - `skills/productivity/google-workspace/scripts/google_api.py` — no matching test reference detected
-  - `wizards/allegro/home/skills/productivity/google-workspace/scripts/google_api.py` — no matching test reference detected
-  - `morrowind/pilot.py` — no matching test reference detected
-  - `scripts/sovereignty_audit.py` — no matching test reference detected
-  - `skills/research/domain-intel/scripts/domain_intel.py` — no matching test reference detected
-  - `wizards/allegro/home/skills/research/domain-intel/scripts/domain_intel.py` — no matching test reference detected
-  - `timmy-local/scripts/ingest.py` — no matching test reference detected
-  - `uni-wizard/scripts/generate_scorecard.py` — no matching test reference detected
+### Network/runtime surface
 
-## Security Audit Findings
+- `python3 server.py`
+  - Starts the WebSocket bridge on port `8765`
+- `python3 l402_server.py`
+  - Local HTTP microservice for cost-estimate style responses
+- `python3 multi_user_bridge.py`
+  - Multi-user HTTP/chat bridge
 
-- [medium] `briefings/briefing_20260325.json:37` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `"gitea_error": "Gitea 404: {\"errors\":null,\"message\":\"not found\",\"url\":\"http://143.198.27.163:3000/api/swagger\"}\n [http://143.198.27.163:3000/api/v1/repos/Timmy_Foundation/sovereign-orchestration/issues?state=open&type=issues&sort=created&direction=desc&limit=1&page=1]",`
-- [medium] `briefings/briefing_20260328.json:11` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `"provider_base_url": "http://localhost:8081/v1",`
-- [medium] `briefings/briefing_20260329.json:11` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `"provider_base_url": "http://localhost:8081/v1",`
-- [medium] `config.yaml:37` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `summary_base_url: http://localhost:11434/v1`
-- [medium] `config.yaml:47` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:52` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:57` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:62` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:67` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:77` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:82` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: 'http://localhost:11434/v1'`
-- [medium] `config.yaml:174` — hardcoded http endpoint: plaintext or fixed HTTP endpoints can drift or leak across environments. Evidence: `base_url: http://localhost:11434/v1`
+### Harness / operator CLI surfaces
 
-## Dead Code Candidates
+- `python3 nexus/morrowind_harness.py`
+- `python3 nexus/bannerlord_harness.py`
+- `python3 mempalace/tunnel_sync.py --peer <url> [--dry-run] [--n N]`
+- `python3 mcp_servers/desktop_control_server.py`
+- `python3 mcp_servers/steam_info_server.py`
 
-- `wizards/allegro/home/skills/red-teaming/godmode/scripts/auto_jailbreak.py` — not imported by indexed Python modules and not referenced by tests
-- `timmy-local/cache/agent_cache.py` — not imported by indexed Python modules and not referenced by tests
-- `wizards/allegro/home/skills/red-teaming/godmode/scripts/parseltongue.py` — not imported by indexed Python modules and not referenced by tests
-- `wizards/allegro/home/skills/red-teaming/godmode/scripts/godmode_race.py` — not imported by indexed Python modules and not referenced by tests
-- `skills/productivity/google-workspace/scripts/google_api.py` — not imported by indexed Python modules and not referenced by tests
-- `wizards/allegro/home/skills/productivity/google-workspace/scripts/google_api.py` — not imported by indexed Python modules and not referenced by tests
-- `morrowind/pilot.py` — not imported by indexed Python modules and not referenced by tests
-- `scripts/sovereignty_audit.py` — not imported by indexed Python modules and not referenced by tests
-- `skills/research/domain-intel/scripts/domain_intel.py` — not imported by indexed Python modules and not referenced by tests
-- `wizards/allegro/home/skills/research/domain-intel/scripts/domain_intel.py` — not imported by indexed Python modules and not referenced by tests
+### Validation surface
 
-## Performance Bottleneck Analysis
+- `python3 -m pytest tests/test_portals_json.py tests/test_index_html_integrity.py tests/test_repo_truth.py -q`
+- `node --test tests/boot.test.js`
+- `python3 -m py_compile server.py nexus/morrowind_harness.py nexus/bannerlord_harness.py mempalace/tunnel_sync.py mcp_servers/desktop_control_server.py`
+- `tests/test_browser_smoke.py` defines the higher-cost Playwright smoke contract for the world shell
 
-- `angband/mcp_server.py` — large module (353 lines) likely hides multiple responsibilities
-- `evennia/timmy_world/game.py` — large module (1541 lines) likely hides multiple responsibilities
-- `evennia/timmy_world/world/game.py` — large module (1345 lines) likely hides multiple responsibilities
-- `morrowind/mcp_server.py` — large module (451 lines) likely hides multiple responsibilities
-- `morrowind/pilot.py` — large module (459 lines) likely hides multiple responsibilities
-- `pipelines/codebase_genome.py` — large module (557 lines) likely hides multiple responsibilities
-- `scripts/fleet_progression.py` — large module (361 lines) likely hides multiple responsibilities
-- `scripts/know_thy_father/crossref_audit.py` — large module (657 lines) likely hides multiple responsibilities
-- `scripts/know_thy_father/index_media.py` — large module (405 lines) likely hides multiple responsibilities
-- `scripts/know_thy_father/synthesize_kernels.py` — large module (416 lines) likely hides multiple responsibilities
+## Test Coverage Gaps
+
+Strongly covered in this checkout:
+- `tests/test_portals_json.py` validates `portals.json`
+- `tests/test_index_html_integrity.py` checks merge-marker/DOM-integrity regressions in `index.html`
+- `tests/boot.test.js` verifies `boot.js` startup behavior
+- `tests/test_repo_truth.py` validates the repo-truth documents
+- Multiple `tests/test_mempalace_*.py` files cover the palace layer
+- `tests/test_bannerlord_harness.py` exists for the Bannerlord harness
+
+Notable gaps or weak seams:
+- `nexus/morrowind_harness.py` is large and operationally critical, but the generated baseline still flags it as a gap relative to its size/complexity
+- `mcp_servers/desktop_control_server.py` exposes high-power automation but has no obvious dedicated test file in the root `tests/` suite
+- `app.js` is the dominant browser runtime file and mixes rendering, GOFAI, metrics, and integration logic in one place; browser smoke exists, but there is limited unit-level decomposition around those subsystems
+- `mempalace.js` appears minimally bridged and stale relative to the richer Python MemPalace layer
+- `multi_user_bridge.py` is a large integration surface and should be treated as high regression risk even though it is central to operator/chat flow
+
+## Security Considerations
+
+- `server.py` binds `HOST = "0.0.0.0"`, exposing the broadcast bridge beyond localhost unless network controls limit it
+- The WebSocket bridge is a broadcast hub without visible authentication in `server.py`; connected clients are trusted to send messages into the bus
+- `mcp_servers/desktop_control_server.py` exposes mouse/keyboard/screenshot control through a stdio MCP server. In any non-local or poorly isolated runtime, this is a privileged automation surface
+- `app.js` contains hardcoded local/network endpoints such as `http://localhost:${L402_PORT}/api/cost-estimate` and `http://localhost:8082/metrics`; these are convenient for local development but create environment drift and deployment assumptions
+- `app.js` also embeds explicit endpoint/status references like `ws://143.198.27.163:8765`, which is operationally brittle and the kind of hardcoded location data that drifts across environments
+- `mempalace.js` shells out through `window.electronAPI.execPython(...)`; this is powerful and useful, but it is a clear trust boundary between UI and host execution
+- `INVESTIGATION_ISSUE_1145.md` documents an earlier integrity hazard: agents writing to `public/nexus/` instead of canonical root paths. That path confusion is both an operational and security concern because it makes provenance harder to reason about
+
+## Runtime Truth and Docs Drift
+
+The most important architecture finding in this repo is not a class or subsystem. It is a truth mismatch.
+
+- README.md says current `main` does not ship a browser 3D world
+- CLAUDE.md declares root `app.js` and `index.html` as canonical frontend paths
+- tests and browser contract now assume the root frontend exists
+
+All three statements are simultaneously present in this checkout.
+
+Grounded evidence:
+- `README.md` still says the repo does not contain an active root frontend such as `index.html`, `app.js`, or `style.css`
+- the current checkout does contain `index.html`, `app.js`, `style.css`, `manifest.json`, and `gofai_worker.js`
+- `BROWSER_CONTRACT.md` explicitly treats those root files as required browser assets
+- `tests/test_browser_smoke.py` serves those exact files and validates DOM/WebGL contracts against them
+- `tests/test_index_html_integrity.py` assumes `index.html` is canonical and production-relevant
+- `CLAUDE.md` says frontend code lives at repo root and explicitly warns against `public/nexus/`
+- `INVESTIGATION_ISSUE_1145.md` explains why `public/nexus/` is a bad/corrupt duplicate path and confirms the real classical AI code lives in root `app.js`
+
+The honest conclusion:
+- The repo contains a partially restored or actively re-materialized browser surface
+- The docs are preserving an older migration truth while the runtime files and smoke contracts describe a newer present-tense truth
+- Any future work in `the-nexus` must choose one truth and align `README.md`, `CLAUDE.md`, smoke tests, and file layout around it
+
+That drift is itself a critical architectural fact and should be treated as first-order design debt, not a side note.

scripts/fleet_cost_report.py

@@ -0,0 +1,245 @@
+#!/usr/bin/env python3
+"""Fleet cost report generator.
+
+Reads Timmy's sovereignty metrics database and estimates paid API spend by
+agent/provider lane. Default output targets the local timmy-config reports
+folder so the cost report can be filed from the sidecar repo.
+"""
+
+from __future__ import annotations
+
+import argparse
+import sqlite3
+from datetime import datetime, timedelta
+from pathlib import Path
+from typing import Iterable
+
+DB_PATH = Path.home() / ".timmy" / "metrics" / "model_metrics.db"
+
+
+AGENT_LANES = (
+    {
+        "agent": "Timmy Cloud Lane",
+        "provider": "OpenRouter",
+        "patterns": ("openrouter/", "google/", "deepseek/", "x-ai/", "mistral/"),
+        "notes": "Cloud fallback and external reasoning routed through OpenRouter-compatible lanes.",
+    },
+    {
+        "agent": "Ezra",
+        "provider": "Anthropic",
+        "patterns": ("claude-", "anthropic/claude"),
+        "notes": "Archivist / long-form reasoning house on Claude-family models.",
+    },
+    {
+        "agent": "Bezalel",
+        "provider": "OpenAI",
+        "patterns": ("gpt-", "openai/", "codex"),
+        "notes": "Forge / implementation house on Codex/OpenAI-backed execution lanes.",
+    },
+    {
+        "agent": "Allegro",
+        "provider": "Kimi / Moonshot",
+        "patterns": ("kimi", "moonshot"),
+        "notes": "Tempo-and-dispatch house on Kimi / Moonshot direct API lanes.",
+    },
+)
+
+
+def default_report_path(report_date: str | None = None) -> Path:
+    if report_date is None:
+        report_date = datetime.now().strftime("%Y-%m-%d")
+    return Path.home() / "code" / "timmy-config" / "reports" / "production" / f"{report_date}-fleet-cost-report.md"
+
+
+def match_lane(model: str) -> dict | None:
+    lowered = (model or "").lower()
+    for lane in AGENT_LANES:
+        if any(pattern in lowered for pattern in lane["patterns"]):
+            return lane
+    return None
+
+
+def load_cost_rows(days: int = 30, db_path: Path = DB_PATH) -> list[tuple[str, int, int, int, float]]:
+    if not db_path.exists():
+        return []
+    cutoff = (datetime.now() - timedelta(days=days)).timestamp()
+    with sqlite3.connect(str(db_path)) as conn:
+        rows = conn.execute(
+            """
+            SELECT model, SUM(sessions), SUM(messages), SUM(tool_calls), SUM(est_cost_usd)
+            FROM session_stats
+            WHERE timestamp > ? AND is_local = 0
+            GROUP BY model
+            ORDER BY SUM(est_cost_usd) DESC, model ASC
+            """,
+            (cutoff,),
+        ).fetchall()
+    return [
+        (model, int(sessions or 0), int(messages or 0), int(tool_calls or 0), float(cost or 0.0))
+        for model, sessions, messages, tool_calls, cost in rows
+    ]
+
+
+def summarize_rows(rows: Iterable[tuple[str, int, int, int, float]], days: int = 30) -> dict:
+    rows = list(rows)
+    agents: dict[str, dict] = {}
+    providers_seen: set[str] = set()
+    inventory = [
+        {
+            "agent": lane["agent"],
+            "provider": lane["provider"],
+            "notes": lane["notes"],
+        }
+        for lane in AGENT_LANES
+    ]
+
+    for lane in AGENT_LANES:
+        agents[lane["agent"]] = {
+            "provider": lane["provider"],
+            "models": [],
+            "sessions": 0,
+            "messages": 0,
+            "tool_calls": 0,
+            "monthly_cost_usd": 0.0,
+            "daily_cost_usd": 0.0,
+            "notes": lane["notes"],
+        }
+
+    unassigned = {
+        "provider": "Unassigned",
+        "models": [],
+        "sessions": 0,
+        "messages": 0,
+        "tool_calls": 0,
+        "monthly_cost_usd": 0.0,
+        "daily_cost_usd": 0.0,
+        "notes": "Observed paid-model spend not yet mapped to a named wizard house.",
+    }
+
+    for model, sessions, messages, tool_calls, monthly_cost in rows:
+        lane = match_lane(model)
+        if lane is None:
+            bucket = unassigned
+        else:
+            bucket = agents[lane["agent"]]
+            providers_seen.add(lane["provider"])
+        bucket["models"].append(
+            {
+                "model": model,
+                "sessions": sessions,
+                "messages": messages,
+                "tool_calls": tool_calls,
+                "monthly_cost_usd": round(monthly_cost, 4),
+            }
+        )
+        bucket["sessions"] += sessions
+        bucket["messages"] += messages
+        bucket["tool_calls"] += tool_calls
+        bucket["monthly_cost_usd"] += monthly_cost
+
+    for bucket in list(agents.values()) + [unassigned]:
+        bucket["monthly_cost_usd"] = round(bucket["monthly_cost_usd"], 4)
+        bucket["daily_cost_usd"] = round(bucket["monthly_cost_usd"] / max(days, 1), 4)
+
+    if unassigned["models"]:
+        agents["Unassigned"] = unassigned
+        providers_seen.add("Unassigned")
+
+    total_monthly = round(sum(item["monthly_cost_usd"] for item in agents.values()), 4)
+    total_daily = round(sum(item["daily_cost_usd"] for item in agents.values()), 4)
+
+    provider_order = sorted(providers_seen)
+    if "Unassigned" in provider_order:
+        provider_order = [p for p in provider_order if p != "Unassigned"] + ["Unassigned"]
+
+    return {
+        "days": days,
+        "providers": provider_order,
+        "inventory": inventory,
+        "agents": agents,
+        "total_monthly_cost_usd": total_monthly,
+        "total_daily_cost_usd": total_daily,
+    }
+
+
+def render_markdown(summary: dict, report_date: str | None = None) -> str:
+    if report_date is None:
+        report_date = datetime.now().strftime("%Y-%m-%d")
+    lines = [
+        f"# Fleet Cost Report — {report_date}",
+        "",
+        f"Window: last {summary['days']} days of paid-model session stats from `~/.timmy/metrics/model_metrics.db`.",
+        "",
+        "## Paid API inventory",
+        "",
+        "| Agent | Provider | Notes |",
+        "| --- | --- | --- |",
+    ]
+    for item in summary["inventory"]:
+        lines.append(f"| {item['agent']} | {item['provider']} | {item['notes']} |")
+
+    lines.extend(
+        [
+            "",
+            "## Estimated cost per agent per day",
+            "",
+            "| Agent | Provider | Daily cost | Monthly estimate | Sessions | Messages | Tool calls |",
+            "| --- | --- | ---: | ---: | ---: | ---: | ---: |",
+        ]
+    )
+    for agent, data in summary["agents"].items():
+        lines.append(
+            f"| {agent} | {data['provider']} | ${data['daily_cost_usd']:.2f} | ${data['monthly_cost_usd']:.2f} | {data['sessions']} | {data['messages']} | {data['tool_calls']} |"
+        )
+
+    lines.extend(
+        [
+            "",
+            f"Total estimated daily paid spend: ${summary['total_daily_cost_usd']:.2f}",
+            f"Total estimated monthly paid spend: ${summary['total_monthly_cost_usd']:.2f}",
+            "",
+            "## Model evidence",
+            "",
+        ]
+    )
+    for agent, data in summary["agents"].items():
+        lines.append(f"### {agent}")
+        if not data["models"]:
+            lines.append("- No paid-model sessions observed in the selected window.")
+        else:
+            for model in data["models"]:
+                lines.append(
+                    f"- `{model['model']}` — {model['sessions']} sessions / {model['messages']} messages / {model['tool_calls']} tool calls / ${model['monthly_cost_usd']:.2f} est."
+                )
+        lines.append("")
+
+    lines.append("Generated by `python3 scripts/fleet_cost_report.py --days 30`. Default output path targets the local timmy-config report lane.")
+    lines.append("")
+    return "\n".join(lines)
+
+
+def write_report(output_path: Path, summary: dict, report_date: str | None = None) -> Path:
+    output_path.parent.mkdir(parents=True, exist_ok=True)
+    output_path.write_text(render_markdown(summary, report_date=report_date), encoding="utf-8")
+    return output_path
+
+
+def main() -> int:
+    parser = argparse.ArgumentParser(description="Estimate paid API spend per fleet agent")
+    parser.add_argument("--days", type=int, default=30, help="Lookback window in days")
+    parser.add_argument("--db-path", default=str(DB_PATH), help="Path to model_metrics.db")
+    parser.add_argument("--output", help="Optional markdown output path")
+    parser.add_argument("--date", help="Override report date (YYYY-MM-DD)")
+    args = parser.parse_args()
+
+    rows = load_cost_rows(days=args.days, db_path=Path(args.db_path).expanduser())
+    summary = summarize_rows(rows, days=args.days)
+    report_date = args.date or datetime.now().strftime("%Y-%m-%d")
+    output_path = Path(args.output).expanduser() if args.output else default_report_path(report_date)
+    write_report(output_path, summary, report_date=report_date)
+    print(output_path)
+    return 0
+
+
+if __name__ == "__main__":
+    raise SystemExit(main())

tests/test_fleet_cost_report.py

@@ -0,0 +1,77 @@
+from importlib.util import module_from_spec, spec_from_file_location
+from pathlib import Path
+import tempfile
+import unittest
+
+
+ROOT = Path(__file__).resolve().parent.parent
+SCRIPT_PATH = ROOT / "scripts" / "fleet_cost_report.py"
+
+
+def load_module():
+    spec = spec_from_file_location("fleet_cost_report", SCRIPT_PATH)
+    module = module_from_spec(spec)
+    assert spec.loader is not None
+    spec.loader.exec_module(module)
+    return module
+
+
+class TestFleetCostReport(unittest.TestCase):
+    def test_default_output_targets_timmy_config_report_path(self):
+        module = load_module()
+        output_path = module.default_report_path("2026-04-22")
+        self.assertIn("timmy-config", str(output_path))
+        self.assertTrue(str(output_path).endswith("2026-04-22-fleet-cost-report.md"))
+
+    def test_summary_groups_paid_costs_by_agent_and_provider(self):
+        module = load_module()
+        rows = [
+            ("claude-sonnet-4-6", 12, 120, 24, 6.0),
+            ("gpt-5.4", 6, 60, 12, 3.0),
+            ("openrouter/google/gemini-2.5-pro", 4, 40, 8, 2.0),
+            ("kimi-k2", 2, 20, 4, 1.0),
+        ]
+        summary = module.summarize_rows(rows, days=30)
+
+        self.assertEqual(summary["providers"], ["Anthropic", "Kimi / Moonshot", "OpenAI", "OpenRouter"])
+        self.assertAlmostEqual(summary["agents"]["Ezra"]["monthly_cost_usd"], 6.0)
+        self.assertAlmostEqual(summary["agents"]["Bezalel"]["monthly_cost_usd"], 3.0)
+        self.assertAlmostEqual(summary["agents"]["Timmy Cloud Lane"]["monthly_cost_usd"], 2.0)
+        self.assertAlmostEqual(summary["agents"]["Allegro"]["monthly_cost_usd"], 1.0)
+        self.assertAlmostEqual(summary["agents"]["Ezra"]["daily_cost_usd"], 0.2)
+
+    def test_report_render_mentions_inventory_and_agent_costs(self):
+        module = load_module()
+        rows = [
+            ("claude-sonnet-4-6", 12, 120, 24, 6.0),
+            ("gpt-5.4", 6, 60, 12, 3.0),
+            ("openrouter/google/gemini-2.5-pro", 4, 40, 8, 2.0),
+        ]
+        summary = module.summarize_rows(rows, days=30)
+        report = module.render_markdown(summary, report_date="2026-04-22")
+
+        self.assertIn("# Fleet Cost Report — 2026-04-22", report)
+        self.assertIn("## Paid API inventory", report)
+        self.assertIn("Anthropic", report)
+        self.assertIn("OpenRouter", report)
+        self.assertIn("OpenAI", report)
+        self.assertIn("## Estimated cost per agent per day", report)
+        self.assertIn("Timmy Cloud Lane", report)
+        self.assertIn("Ezra", report)
+        self.assertIn("Bezalel", report)
+
+    def test_write_report_creates_markdown_file(self):
+        module = load_module()
+        rows = [("claude-sonnet-4-6", 1, 10, 2, 0.5)]
+        summary = module.summarize_rows(rows, days=30)
+        with tempfile.TemporaryDirectory() as tmpdir:
+            dest = Path(tmpdir) / "fleet-cost.md"
+            module.write_report(dest, summary, report_date="2026-04-22")
+            self.assertTrue(dest.exists())
+            text = dest.read_text()
+            self.assertIn("Fleet Cost Report", text)
+            self.assertIn("Ezra", text)
+
+
+if __name__ == "__main__":
+    unittest.main()