Alexander Whitestone 220f20c794 feat: add desktop automation primitives to Hermes (#1125) ...

Implements Phase 1 and Phase 2 tooling from issue #1125:

- nexus/computer_use.py: four Hermes tools with poka-yoke safety
    * computer_screenshot() — capture & base64-encode desktop snapshot
    * computer_click(x, y, button, confirm) — right/middle require confirm=True
    * computer_type(text, confirm) — sensitive keywords blocked without confirm=True;
      text value is never written to audit log
    * computer_scroll(x, y, amount) — scroll wheel
    * read_action_log() — inspect recent JSONL audit entries
    * pyautogui.FAILSAFE=True; all tools degrade gracefully when headless

- nexus/computer_use_demo.py: Phase 1 demo (baseline screenshot →
  open browser → navigate to Gitea forge → evidence screenshot)

- tests/test_computer_use.py: 32 unit tests, fully headless
  (pyautogui mocked), all passing

- docs/computer-use.md: API reference, safety table, phase roadmap,
  pilot recipes

- docker-compose.desktop.yml: sandboxed Xvfb + noVNC container

Fixes #1125

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

2026-04-10 05:45:27 -04:00

..

fixtures/fleet_palace/bezalel

[claude] Weekly privacy audit cron + fleet HTTP API (#1075) (#1109)

2026-04-07 14:54:41 +00:00

quarantine

[claude] Poka-yoke: make test skips/flakes impossible to ignore (#1094) (#1104)

2026-04-07 14:38:49 +00:00

conftest.py

[claude] Poka-yoke: make test skips/flakes impossible to ignore (#1094) (#1104)

2026-04-07 14:38:49 +00:00

test_bannerlord_harness.py

feat: Complete Bannerlord MCP Harness implementation (Issue #722)

2026-03-31 04:53:29 +00:00

test_bezalel_heartbeat.py

[claude] Poka-yoke cron heartbeats: write, check, and report (#1096) (#1107)

2026-04-07 14:44:05 +00:00

test_computer_use.py

feat: add desktop automation primitives to Hermes (#1125)

2026-04-10 05:45:27 -04:00

test_cron_heartbeats.py

[claude] Poka-yoke cron heartbeats — make silent failures impossible (#1096) (#1102)

2026-04-07 14:38:55 +00:00

test_edge_tts.py

feat: add edge-tts as zero-cost voice output provider

2026-04-08 06:29:26 -04:00

test_evennia_event_adapter.py

feat: add thin Evennia to Nexus event adapter

2026-03-28 16:02:27 -04:00

test_evennia_mempalace_commands.py

[claude] MemPalace follow-up: CmdAsk, metadata fix, taxonomy CI (#1075) (#1091)

2026-04-07 14:23:07 +00:00

test_evennia_ws_bridge.py

feat: feed Evennia world events into Nexus websocket bridge

2026-03-28 16:25:18 -04:00

test_gemini_harness.py

[claude] Stand up Gemini harness as network worker (#748) (#811)

2026-04-04 01:41:53 +00:00

test_help_page.py

[claude] Add /help page for Nexus web frontend (#833) (#887)

2026-04-06 17:52:10 +00:00

test_manifest.py

[claude] Fix missing manifest.json PWA support (#832) (#888)

2026-04-06 17:59:45 +00:00

test_mempalace_audit_privacy.py

[claude] MemPalace × Evennia fleet memory scaffold (#1075) (#1088)

2026-04-07 14:12:38 +00:00

test_mempalace_fleet_api.py

[claude] Weekly privacy audit cron + fleet HTTP API (#1075) (#1109)

2026-04-07 14:54:41 +00:00

test_mempalace_retain_closets.py

feat(mempalace): retention enforcement + tunnel sync client (#1083, #1078)

2026-04-07 11:05:00 -04:00

test_mempalace_searcher.py

[claude] MemPalace × Evennia fleet memory scaffold (#1075) (#1088)

2026-04-07 14:12:38 +00:00

test_mempalace_tunnel_sync.py

feat(mempalace): retention enforcement + tunnel sync client (#1083, #1078)

2026-04-07 11:05:00 -04:00

test_mempalace_validate_rooms.py

[claude] MemPalace × Evennia fleet memory scaffold (#1075) (#1088)

2026-04-07 14:12:38 +00:00

test_nexus_watchdog.py

[watchdog] The Eye That Never Sleeps — Nexus Health Monitor (#794)

2026-04-04 01:36:56 +00:00

test_portal_registry_schema.py

feat: expand portal registry schema (#718)

2026-03-28 17:01:49 +00:00

test_repo_truth.py

docs: sync nexus repo truth and audit legacy matrix (#689)

2026-03-28 12:53:20 +00:00

test_syntax_fixes.py

[fix] 5 bugs: 2 SyntaxErrors in nexus_think.py, Groq model name, server race condition, corrupt public/nexus/

2026-03-30 19:04:53 -04:00

test_webhook_health_dashboard.py

[timmy] Add webhook health dashboard (#855) (#885)

2026-04-06 15:51:22 +00:00