From 0871e48dddfcd953239a042de130008ec84cd840 Mon Sep 17 00:00:00 2001 From: Google AI Agent Date: Sun, 5 Apr 2026 21:30:28 +0000 Subject: [PATCH] docs: add Sovereign Efficiency & Cost Saving Guide --- COST_SAVING.md | 41 +++++++++++++++++++++++++++++++++++++++++ 1 file changed, 41 insertions(+) create mode 100644 COST_SAVING.md diff --git a/COST_SAVING.md b/COST_SAVING.md new file mode 100644 index 00000000..c66880cf --- /dev/null +++ b/COST_SAVING.md @@ -0,0 +1,41 @@ + +# Sovereign Efficiency: Local-First & Cost Saving Guide + +This guide outlines the strategy for eliminating waste and optimizing flow within the Timmy Foundation ecosystem. + +## 1. Smart Model Routing (SMR) +**Goal:** Use the right tool for the job. Don't use a 14B or 70B model to say "Hello" or "Task complete." + +- **Action:** Enable `smart_model_routing` in `config.yaml`. +- **Logic:** + - Simple acknowledgments and status updates -> **Gemma 2B / Phi-3 Mini** (Local). + - Complex reasoning and coding -> **Hermes 14B / Llama 3 70B** (Local). + - Fortress-grade synthesis -> **Claude 3.5 Sonnet / Gemini 1.5 Pro** (Cloud - Emergency Only). + +## 2. Context Compression +**Goal:** Keep the KV cache lean. Long sessions shouldn't slow down the "Thought Stream." + +- **Action:** Enable `compression` in `config.yaml`. +- **Threshold:** Set to `0.5` to trigger summarization when the context is half full. +- **Protect Last N:** Keep the last 20 turns in raw format for immediate coherence. + +## 3. Parallel Symbolic Execution (PSE) Optimization +**Goal:** Reduce redundant reasoning cycles in The Nexus. + +- **Action:** The Nexus now uses **Adaptive Reasoning Frequency**. If the world stability is high (>0.9), reasoning cycles are halved. +- **Benefit:** Reduces CPU/GPU load on the local harness, leaving more headroom for inference. + +## 4. L402 Cost Transparency +**Goal:** Treat compute as a finite resource. + +- **Action:** Use the **Sovereign Health HUD** in The Nexus to monitor L402 challenges. +- **Metric:** Track "Sats per Thought" to identify which agents are "token-heavy." + +## 5. Waste Elimination (Ghost Triage) +**Goal:** Remove stale state. + +- **Action:** Run the `triage_sprint.ts` script weekly to assign or archive stale issues. +- **Action:** Use `hermes --flush-memories` to clear outdated context that no longer serves the current mission. + +--- +*Sovereignty is not just about ownership; it is about stewardship of resources.*