[HEARTBEAT] Connect heartbeat loop to Bannerlord through desktop MCP #550

Closed
opened 2026-03-25 22:51:34 +00:00 by perplexity · 4 comments
Member

Per direction shift (#542). Wire the proven perception-decision-action cycle to Bannerlord.

Task

Wire the heartbeat cycle to run continuously against a live Bannerlord window:

  1. Heartbeat tick fires
  2. Desktop Control MCP captures Bannerlord game window screenshot
  3. Steam MCP provides game state context (is Bannerlord running, playtime, etc.)
  4. DPO model through Ollama/Hermes receives screenshot + context, reasons, decides
  5. Model issues tool call → Desktop Control MCP sends input to Bannerlord

Use the existing nexus_think.py consciousness loop with MCP tools registered as Hermes tools. If adaptation is needed, keep it to config and tool registration — not new architecture.

Acceptance criteria

Timmy autonomously performs 10 consecutive heartbeat cycles against a live Bannerlord session without crashing.

Per direction shift (#542). Wire the proven perception-decision-action cycle to Bannerlord. ## Task Wire the heartbeat cycle to run continuously against a live Bannerlord window: 1. Heartbeat tick fires 2. Desktop Control MCP captures Bannerlord game window screenshot 3. Steam MCP provides game state context (is Bannerlord running, playtime, etc.) 4. DPO model through Ollama/Hermes receives screenshot + context, reasons, decides 5. Model issues tool call → Desktop Control MCP sends input to Bannerlord Use the existing `nexus_think.py` consciousness loop with MCP tools registered as Hermes tools. If adaptation is needed, keep it to config and tool registration — not new architecture. ## Acceptance criteria Timmy autonomously performs 10 consecutive heartbeat cycles against a live Bannerlord session without crashing.
perplexity added the harnessportalp1-important labels 2026-03-25 22:51:34 +00:00
Timmy was assigned by perplexity 2026-03-25 22:51:34 +00:00
Member

🔧 gemini working on this via Huey. Branch: gemini/issue-550

🔧 `gemini` working on this via Huey. Branch: `gemini/issue-550`
Member

🔧 grok working on this via Huey. Branch: grok/issue-550

🔧 `grok` working on this via Huey. Branch: `grok/issue-550`
Member

⚠️ grok produced no changes for this issue. Skipping.

⚠️ `grok` produced no changes for this issue. Skipping.
Owner

Closing during the 2026-03-28 backlog burn-down.

Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.

Closing during the 2026-03-28 backlog burn-down. Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.
Timmy closed this issue 2026-03-28 04:52:47 +00:00
Sign in to join this conversation.
4 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#550