Timmy_Foundation/the-nexus
16
1
Fork 2
Code Issues 109 Pull Requests Actions 16 Packages Projects Releases Wiki Activity

[PORTAL] pilot.py — deterministic motor control loop for Morrowind #661

New Issue
Closed
opened 2026-03-27 16:55:32 +00:00 by perplexity · 32 comments
perplexity commented 2026-03-27 16:55:32 +00:00
Member
Copy Link

What

A ~100 line Python script that handles real-time motor control in Morrowind. No LLM. Pure behavior tree. Runs at 100ms tick rate.

Behavior Tree (v1)

every 100ms:
  perception = parse_latest_perception()
  
  if enemy_nearby(perception):
    face_enemy() → attack()
  elif npc_nearby(perception):
    walk_toward_npc() → activate()
  elif door_nearby(perception):
    walk_toward_door() → activate()
  elif goal == "explore":
    walk_forward(2s)
    random_turn()
  else:
    idle()
  
  log_trajectory(perception, action, timestamp)

Reads From

  • OpenMW log via parse_latest_perception() (existing function in mcp_server.py)
  • ~/.timmy/morrowind/current_goal.txt (set by Timmy or reflex layer)

Writes To

  • Game window via send_key() (existing function in mcp_server.py)
  • ~/.timmy/morrowind/trajectories/YYYYMMDD.jsonl (training data)

Runs As

python3 ~/.timmy/morrowind/pilot.py

Standalone process alongside Hermes TUI and llama-server. No dependencies beyond what's already installed.

Acceptance Criteria

  • Pilot explores autonomously — walks, turns, enters doors, approaches NPCs
  • Logs every perception-action pair to JSONL
  • Reads goal from current_goal.txt
  • Doesn't crash when perception data is stale or missing
  • Can be stopped with Ctrl+C cleanly
## What A ~100 line Python script that handles real-time motor control in Morrowind. No LLM. Pure behavior tree. Runs at 100ms tick rate. ## Behavior Tree (v1) ``` every 100ms: perception = parse_latest_perception() if enemy_nearby(perception): face_enemy() → attack() elif npc_nearby(perception): walk_toward_npc() → activate() elif door_nearby(perception): walk_toward_door() → activate() elif goal == "explore": walk_forward(2s) random_turn() else: idle() log_trajectory(perception, action, timestamp) ``` ## Reads From - OpenMW log via `parse_latest_perception()` (existing function in mcp_server.py) - `~/.timmy/morrowind/current_goal.txt` (set by Timmy or reflex layer) ## Writes To - Game window via `send_key()` (existing function in mcp_server.py) - `~/.timmy/morrowind/trajectories/YYYYMMDD.jsonl` (training data) ## Runs As ```bash python3 ~/.timmy/morrowind/pilot.py ``` Standalone process alongside Hermes TUI and llama-server. No dependencies beyond what's already installed. ## Acceptance Criteria - [ ] Pilot explores autonomously — walks, turns, enters doors, approaches NPCs - [ ] Logs every perception-action pair to JSONL - [ ] Reads goal from current_goal.txt - [ ] Doesn't crash when perception data is stale or missing - [ ] Can be stopped with Ctrl+C cleanly
perplexity added the portalp1-important labels 2026-03-27 16:55:32 +00:00
Timmy commented 2026-03-27 17:00:23 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 17:00:50 +00:00
Owner
Copy Link

⚡ Dispatched to claude. Huey task queued.

⚡ Dispatched to `claude`. Huey task queued.
Timmy commented 2026-03-27 17:00:52 +00:00
Owner
Copy Link

⚡ Dispatched to gemini. Huey task queued.

⚡ Dispatched to `gemini`. Huey task queued.
Timmy commented 2026-03-27 17:00:55 +00:00
Owner
Copy Link

⚡ Dispatched to kimi. Huey task queued.

⚡ Dispatched to `kimi`. Huey task queued.
Timmy commented 2026-03-27 17:00:59 +00:00
Owner
Copy Link

⚡ Dispatched to grok. Huey task queued.

⚡ Dispatched to `grok`. Huey task queued.
Timmy commented 2026-03-27 17:01:03 +00:00
Owner
Copy Link

⚡ Dispatched to perplexity. Huey task queued.

⚡ Dispatched to `perplexity`. Huey task queued.
Timmy commented 2026-03-27 17:15:22 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 17:30:20 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
gemini commented 2026-03-27 17:40:29 +00:00
Member
Copy Link

🔧 gemini working on this via Huey. Branch: gemini/issue-661

🔧 `gemini` working on this via Huey. Branch: `gemini/issue-661`
grok commented 2026-03-27 17:40:36 +00:00
Member
Copy Link

🔧 grok working on this via Huey. Branch: grok/issue-661

🔧 `grok` working on this via Huey. Branch: `grok/issue-661`
grok commented 2026-03-27 17:40:39 +00:00
Member
Copy Link

⚠️ grok produced no changes for this issue. Skipping.

⚠️ `grok` produced no changes for this issue. Skipping.
Timmy commented 2026-03-27 17:45:17 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 18:00:24 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 18:15:24 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 18:30:25 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 18:45:22 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 19:00:20 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 19:15:20 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 19:30:18 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 19:45:21 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 20:00:17 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 20:15:22 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 20:30:19 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 20:45:22 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 21:00:22 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 21:15:23 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 21:30:20 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 21:45:20 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 22:00:21 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 22:15:23 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy commented 2026-03-27 22:30:26 +00:00
Owner
Copy Link

🔍 Triaged by Huey — needs assignment.

🔍 Triaged by Huey — needs assignment.
Timmy was assigned by Rockachopa 2026-03-28 03:54:22 +00:00
Timmy commented 2026-03-28 04:52:20 +00:00
Owner
Copy Link

Closing during the 2026-03-28 backlog burn-down.

Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.

Closing during the 2026-03-28 backlog burn-down. Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.
Timmy closed this issue 2026-03-28 04:52:20 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
3d-world
actionable
agent-presence
aistudio-ready
assigned-aistudio
assigned-claude
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-gemini
assigned-groq
assigned-kimi
assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-perplexity
assigned-sonnet
claude-ready
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 deprioritized
duplicate
epic
Epic / umbrella issue
 gemini-api
Gemini API integration
 gemini-review
google-ai-ultra
Google AI Ultra integration work
 groq-ready
harness
identity
Timmy identity and branding
 infrastructure
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 kimi-ready
media-gen
AI media generation (image/video/audio)
 modularization
needs-design
nostr
p0-critical
p1-important
p2-backlog
performance
perplexity-ready
portal
research
Deep research and planning tasks
 sonnet-ready
sovereignty
velocity-engine
Auto-generated by velocity engine
No Label p1-important portal
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity sonnet
No Assignees Timmy
4 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/the-nexus#661
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?