Timmy_Foundation/timmy-config
16
0
Fork 0
Code Issues 57 Pull Requests 1 Actions 1 Packages Projects Releases Wiki Activity

[HEALTH] Report VRAM utilization and tok/s in model_health task #30

New Issue
Closed
opened 2026-03-27 22:48:30 +00:00 by perplexity · 1 comment
perplexity commented 2026-03-27 22:48:30 +00:00
Member
Copy Link

Source

Sovereign Developer's Brief (2026-03-27), Section 4 "Low-Hanging Fruit", item 1.

What

Extend the model_health() periodic task in tasks.py to report:

  • VRAM utilization (via sysctl on macOS or parsing llama-server metrics endpoint)
  • Tokens-per-second from the inference ping (already runs a 5-token completion — measure wall time)

Why

The health check currently reports binary up/down plus model list. Adding resource metrics makes it possible to detect degradation before it causes failures.

Acceptance

  • model_health.json includes vram_used_mb, vram_total_mb, tokens_per_second
  • No new dependencies (use existing llama-server /metrics or system calls)

Related

  • Existing issue #4 (Verify Huey tasks) covers general health but not these specific metrics.
## Source Sovereign Developer's Brief (2026-03-27), Section 4 "Low-Hanging Fruit", item 1. ## What Extend the `model_health()` periodic task in `tasks.py` to report: - VRAM utilization (via `sysctl` on macOS or parsing `llama-server` metrics endpoint) - Tokens-per-second from the inference ping (already runs a 5-token completion — measure wall time) ## Why The health check currently reports binary up/down plus model list. Adding resource metrics makes it possible to detect degradation before it causes failures. ## Acceptance - `model_health.json` includes `vram_used_mb`, `vram_total_mb`, `tokens_per_second` - No new dependencies (use existing llama-server `/metrics` or system calls) ## Related - Existing issue #4 (Verify Huey tasks) covers general health but not these specific metrics.
Timmy commented 2026-03-28 04:53:04 +00:00
Owner
Copy Link

Closing during the 2026-03-28 backlog burn-down.

Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.

Closing during the 2026-03-28 backlog burn-down. Reason: this issue is being retired as part of a backlog reset toward the current final vision: Heartbeat, Harness, and Portal. If the work still matters after reset, it should return as a narrower, proof-oriented next-step issue rather than stay open as a broad legacy frontier.
Timmy closed this issue 2026-03-28 04:53:04 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
assigned-claw-code
Queued for Code Claw (qwen/openrouter)
 assigned-kimi
Dispatched to Kimi via OpenClaw
 claw-code-done
Code Claw completed this task
 claw-code-in-progress
Code Claw is actively working
 enhancement
epic
kimi-done
Kimi completed this task
 kimi-in-progress
Kimi is actively working on this
 research
velocity-engine
Auto-generated by velocity engine
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
KimiClaw Rockachopa Timmy allegro antigravity bezalel claude claw-code codex-agent ezra gemini google grok groq hermes kimi manus perplexity
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-config#30
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?