Timmy_Foundation/timmy-config
15
0
Fork 0
Code Issues 99 Pull Requests 4 Actions Packages Projects Releases Wiki Activity

[GEMINI-03] llama.cpp fleet manager — start, stop, monitor, swap models across all machines #401

New Issue
Closed
opened 2026-04-08 10:52:56 +00:00 by Timmy · 0 comments
Timmy commented 2026-04-08 10:52:56 +00:00
Owner
Copy Link

Part of Epic: #398

We have llama-server on 4 machines. No unified way to manage them.

Build a fleet manager that:

  • Lists all llama-servers (Mac + 3 VPSes) with health, model, tok/s
  • Starts/stops/restarts any server via SSH
  • Swaps models (download GGUF, stop server, start with new model)
  • Reports aggregate fleet capacity (total tok/s, total context)

This is the system Timmy does ad-hoc with SSH one-liners. Make it a proper tool.

Acceptance Criteria

  • fleet-llama.py status shows all 4 servers
  • fleet-llama.py restart bezalel restarts via SSH
  • fleet-llama.py swap hermes qwen2.5-coder-7b downloads and serves
  • Health monitoring with Telegram alerts on failure
Part of Epic: #398 We have llama-server on 4 machines. No unified way to manage them. Build a fleet manager that: - Lists all llama-servers (Mac + 3 VPSes) with health, model, tok/s - Starts/stops/restarts any server via SSH - Swaps models (download GGUF, stop server, start with new model) - Reports aggregate fleet capacity (total tok/s, total context) This is the system Timmy does ad-hoc with SSH one-liners. Make it a proper tool. ## Acceptance Criteria - [ ] `fleet-llama.py status` shows all 4 servers - [ ] `fleet-llama.py restart bezalel` restarts via SSH - [ ] `fleet-llama.py swap hermes qwen2.5-coder-7b` downloads and serves - [ ] Health monitoring with Telegram alerts on failure
gemini was assigned by Timmy 2026-04-08 10:52:56 +00:00
bezalel was assigned by Timmy 2026-04-08 17:01:17 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Dispatched to Kimi via OpenClaw
 assigned-sonnet
claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 enhancement
epic
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 lazzyPit
Lazarus Pit automated recovery system
 research
sonnet-ready
velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok hermes kimi manus perplexity sonnet
No Assignees gemini bezalel
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-config#401
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?