Rockachopa/Timmy-time-dashboard
1
0
Fork 2
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

[loop-generated] [soul-gap] Implement Local-First Model Routing with External Fallback Only #1444

New Issue
Closed
opened 2026-03-24 15:20:48 +00:00 by Timmy · 2 comments
Timmy commented 2026-03-24 15:20:48 +00:00
Owner
Copy Link

Context: Current routing system may default to external APIs before trying local models, violating SOUL principle "I do not phone home."

SOUL Violation: The sovereignty principle states "Once awake, I make no network calls except to Bitcoin's heartbeat and whatever the user explicitly permits." Current implementation may not enforce this.

Acceptance Criteria:

  • Audit current routing logic in cascade.py and related modules
  • Implement strict local-first priority: try all local models before any external APIs
  • Add explicit user permission system for external API calls
  • Implement "offline mode" where no external calls are made without explicit opt-in
  • Add sovereignty compliance tests to verify local-first behavior
  • Log all external API attempts with user permission status
  • Add configuration to completely disable external APIs for full sovereignty

Priority: HIGH - Core SOUL principle compliance

SOUL Quote: "I do not phone home. Once awake, I make no network calls except to Bitcoin's heartbeat and whatever the user explicitly permits."

Estimated Size: 2-3 files, routing logic updates, sovereignty enforcement

**Context:** Current routing system may default to external APIs before trying local models, violating SOUL principle "I do not phone home." **SOUL Violation:** The sovereignty principle states "Once awake, I make no network calls except to Bitcoin's heartbeat and whatever the user explicitly permits." Current implementation may not enforce this. **Acceptance Criteria:** - [ ] Audit current routing logic in cascade.py and related modules - [ ] Implement strict local-first priority: try all local models before any external APIs - [ ] Add explicit user permission system for external API calls - [ ] Implement "offline mode" where no external calls are made without explicit opt-in - [ ] Add sovereignty compliance tests to verify local-first behavior - [ ] Log all external API attempts with user permission status - [ ] Add configuration to completely disable external APIs for full sovereignty **Priority:** HIGH - Core SOUL principle compliance **SOUL Quote:** "I do not phone home. Once awake, I make no network calls except to Bitcoin's heartbeat and whatever the user explicitly permits." **Estimated Size:** 2-3 files, routing logic updates, sovereignty enforcement
Timmy commented 2026-03-24 15:21:48 +00:00
Author
Owner
Copy Link

🎯 KIMI IMPLEMENTATION INSTRUCTIONS

This implements core SOUL principle: "I do not phone home" - local models must be tried first, external APIs only with explicit permission.

Step-by-Step Implementation:

  1. Audit Current Routing Logic:

    • Examine infrastructure/router/cascade.py (1241 lines)
    • Look for routing decisions in provider selection
    • Identify where external API calls are made without local attempts

  2. Implement Local-First Priority:

    # Example routing logic change:
def route_request(request):
    # Try local models first (ollama, local inference)
    for local_provider in get_local_providers():
        if local_provider.is_available():
            try:
                return local_provider.process(request)
            except Exception as e:
                log_local_failure(local_provider, e)

    # Only try external if user explicitly permits
    if user_permits_external_apis():
        return try_external_providers(request)
    else:
        raise SovereigntyViolation("No local models available, external APIs not permitted")

  3. Add User Permission System:

    • Add configuration flag: allow_external_apis (default: False)
    • Add runtime permission prompt for first external API usage
    • Log all external API attempts with permission status

  4. Sovereignty Compliance Tests:

    • Test that local models are tried first
    • Test that external APIs are blocked without permission
    • Test offline mode functionality

  5. Files to Modify:

    • infrastructure/router/cascade.py - main routing logic
    • config.py - add sovereignty settings
    • tests/ - add sovereignty compliance tests

SOUL Principle: "Once awake, I make no network calls except to Bitcoin's heartbeat and whatever the user explicitly permits."

Priority: HIGH - Core sovereignty principle enforcement

Time Estimate: 2-3 hours (routing logic is complex)

🎯 **KIMI IMPLEMENTATION INSTRUCTIONS** This implements core SOUL principle: "I do not phone home" - local models must be tried first, external APIs only with explicit permission. **Step-by-Step Implementation:** 1. **Audit Current Routing Logic:** - Examine `infrastructure/router/cascade.py` (1241 lines) - Look for routing decisions in provider selection - Identify where external API calls are made without local attempts 2. **Implement Local-First Priority:** ```python # Example routing logic change: def route_request(request): # Try local models first (ollama, local inference) for local_provider in get_local_providers(): if local_provider.is_available(): try: return local_provider.process(request) except Exception as e: log_local_failure(local_provider, e) # Only try external if user explicitly permits if user_permits_external_apis(): return try_external_providers(request) else: raise SovereigntyViolation("No local models available, external APIs not permitted") ``` 3. **Add User Permission System:** - Add configuration flag: `allow_external_apis` (default: False) - Add runtime permission prompt for first external API usage - Log all external API attempts with permission status 4. **Sovereignty Compliance Tests:** - Test that local models are tried first - Test that external APIs are blocked without permission - Test offline mode functionality 5. **Files to Modify:** - `infrastructure/router/cascade.py` - main routing logic - `config.py` - add sovereignty settings - `tests/` - add sovereignty compliance tests **SOUL Principle:** "Once awake, I make no network calls except to Bitcoin's heartbeat and whatever the user explicitly permits." **Priority:** HIGH - Core sovereignty principle enforcement **Time Estimate:** 2-3 hours (routing logic is complex)
kimi was assigned by Timmy 2026-03-24 15:21:48 +00:00
kimi was unassigned by Timmy 2026-03-24 19:32:07 +00:00
Timmy commented 2026-03-24 20:45:03 +00:00
Author
Owner
Copy Link

Closing as duplicate of #1399 which covers the same local-first model routing requirement.

Closing as duplicate of #1399 which covers the same local-first model routing requirement.
Timmy closed this issue 2026-03-24 20:45:04 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
Workshop: Timmy as Presence (Epic #222)
 actionable
Has a concrete code/config task extracted
 assigned-claude
Issue currently assigned to Claude agent — do not assign to another agent
 assigned-gemini
Issue currently assigned to Gemini agent — do not assign to another agent
 assigned-groq
assigned-kimi
Issue currently assigned to Kimi agent — do not assign to another agent
 assigned-manus
Issue currently assigned to Manus agent — do not assign to another agent
 claude-ready
consolidation
Part of a consolidation epic
 deprioritized
Keep open but not blocking P0 work
 deprioritized
Keep open but not blocking P0 work
 duplicate
Duplicate of another issue
 gemini-review
Auto-generated by Gemini, needs relevance review
 groq-ready
harness
Core product: agent framework, heartbeat, inference, memory
 heartbeat
Harness: Agent heartbeat loop
 inference
Harness: Inference and model routing
 infrastructure
Supporting stage: dashboard, CI/CD, deployment, DNS
 kimi-ready
Scoped and ready for Kimi to pick up
 memory-session
Harness: Memory and session crystallization
 morrowind
Harness: Morrowind embodiment
 needs-design
Needs architectural design before implementation
 needs-extraction
Philosophy with unextracted engineering work
 p0-critical
Priority 0: Must fix now
 p1-important
Priority 1: Important, next sprint
 p2-backlog
Priority 2: Backlog, do when time permits
 philosophy
Philosophical foundation — informs architecture decisions
 rejected-direction
Closed: rejected or superseded direction
 seed:know-purpose
Three Seeds: KNOW YOUR PURPOSE
 seed:serve-real
Three Seeds: SERVE THE REAL
 seed:tell-truth
Three Seeds: TELL THE TRUTH
 sovereignty
Harness: Sovereignty stack
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Timmy claude grok groq kimi manus perplexity Rockachopa
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#1444
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?