Timmy_Foundation/the-nexus
16
1
Fork 2
Code Issues 90 Pull Requests Actions 11 Packages Projects Releases Wiki Activity

[HARNESS] Smart model routing — narrow decision space to competency space #609

New Issue
Closed
opened 2026-03-27 01:10:18 +00:00 by perplexity · 13 comments
perplexity commented 2026-03-27 01:10:18 +00:00
Member
Copy Link

Key Insight

"I just need to narrow the decision space based off the competency space. Claude Opus or Gemini for design discussions. A very dumb but very well-aligned model handles simple decisions."

Routing Strategy

Decision Type Model Why
Architecture/design discussions Claude Opus, Gemini High reasoning ceiling
Simple yes/no routing decisions Tiny aligned local model (Phi-3, Gemma 2B) Fast, cheap, no cloud dependency
Code generation Hermes 4 via harness Self-improvement loops capture training data
Math/logic verification Deterministic engine (SymPy/Z3) No hallucination risk
Personality/conversation Soul-file-tuned Hermes 4 Vibe alignment

Implementation

  • Define competency tiers for available models
  • Huey task router inspects task metadata → selects appropriate model
  • Log which model handled which task (feeds into Prometheus metrics)
  • Track cost-per-task across model tiers
  • Sovereignty bonus: prefer local model when confidence is sufficient

Related

  • Depends on local inference telemetry (already wired into Huey)
  • Feeds into sovereignty rubric (% of tasks routed locally vs cloud)

Source: Gemini brainstorm session 2026-03-26 — triaged by Perplexity

## Key Insight > "I just need to narrow the decision space based off the competency space. Claude Opus or Gemini for design discussions. A very dumb but very well-aligned model handles simple decisions." ## Routing Strategy | Decision Type | Model | Why | |---|---|---| | Architecture/design discussions | Claude Opus, Gemini | High reasoning ceiling | | Simple yes/no routing decisions | Tiny aligned local model (Phi-3, Gemma 2B) | Fast, cheap, no cloud dependency | | Code generation | Hermes 4 via harness | Self-improvement loops capture training data | | Math/logic verification | Deterministic engine (SymPy/Z3) | No hallucination risk | | Personality/conversation | Soul-file-tuned Hermes 4 | Vibe alignment | ## Implementation - [ ] Define competency tiers for available models - [ ] Huey task router inspects task metadata → selects appropriate model - [ ] Log which model handled which task (feeds into Prometheus metrics) - [ ] Track cost-per-task across model tiers - [ ] Sovereignty bonus: prefer local model when confidence is sufficient ## Related - Depends on local inference telemetry (already wired into Huey) - Feeds into sovereignty rubric (% of tasks routed locally vs cloud) --- _Source: [Gemini brainstorm session 2026-03-26](https://g.co/gemini/share/3700c8d29b6b) — triaged by Perplexity_
perplexity added the modularizationharnessp1-important labels 2026-03-27 01:10:18 +00:00
Timmy commented 2026-03-27 01:10:28 +00:00
Owner
Copy Link

⚡ Dispatched to claude. Huey task queued.

⚡ Dispatched to `claude`. Huey task queued.
Timmy commented 2026-03-27 01:10:31 +00:00
Owner
Copy Link

⚡ Dispatched to gemini. Huey task queued.

⚡ Dispatched to `gemini`. Huey task queued.
Timmy commented 2026-03-27 01:10:34 +00:00
Owner
Copy Link

⚡ Dispatched to kimi. Huey task queued.

⚡ Dispatched to `kimi`. Huey task queued.
Timmy commented 2026-03-27 01:10:36 +00:00
Owner
Copy Link

⚡ Dispatched to grok. Huey task queued.

⚡ Dispatched to `grok`. Huey task queued.
Timmy commented 2026-03-27 01:10:37 +00:00
Owner
Copy Link

⚡ Dispatched to perplexity. Huey task queued.

⚡ Dispatched to `perplexity`. Huey task queued.
Timmy commented 2026-03-27 01:15:26 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 01:30:21 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
gemini commented 2026-03-27 01:40:30 +00:00
Member
Copy Link

🔧 gemini working on this via Huey. Branch: gemini/issue-609

🔧 `gemini` working on this via Huey. Branch: `gemini/issue-609`
grok commented 2026-03-27 01:40:39 +00:00
Member
Copy Link

🔧 grok working on this via Huey. Branch: grok/issue-609

🔧 `grok` working on this via Huey. Branch: `grok/issue-609`
grok commented 2026-03-27 01:40:42 +00:00
Member
Copy Link

⚠️ grok produced no changes for this issue. Skipping.

⚠️ `grok` produced no changes for this issue. Skipping.
Timmy commented 2026-03-27 01:45:21 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 02:00:18 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-28 04:46:28 +00:00
Owner
Copy Link

Closing as duplicate during backlog burn-down. Canonical issue: #604.

Reason: identical title/workstream. Keeping one thread prevents duplicate agent labor and review waste.

Closing as duplicate during backlog burn-down. Canonical issue: #604. Reason: identical title/workstream. Keeping one thread prevents duplicate agent labor and review waste.
Timmy closed this issue 2026-03-28 04:46:28 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
3d-world
actionable
agent-presence
aistudio-ready
assigned-aistudio
assigned-claude
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-gemini
assigned-groq
assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-kimi
assigned-perplexity
claude-ready
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deprioritized
duplicate
epic
Epic / umbrella issue
 gemini-api
Gemini API integration
 gemini-review
google-ai-ultra
Google AI Ultra integration work
 groq-ready
harness
identity
Timmy identity and branding
 infrastructure
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 kimi-ready
media-gen
AI media generation (image/video/audio)
 modularization
needs-design
nostr
p0-critical
p1-important
p2-backlog
performance
perplexity-ready
portal
research
Deep research and planning tasks
 sovereignty
velocity-engine
Auto-generated by velocity engine
No Label harness modularization p1-important
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity
No Assignees
4 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#609
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?