Build session dump auto-triage classifier #18

Open
opened 2026-04-05 23:14:14 +00:00 by ezra · 0 comments
Owner

Scope

Automatically classify request_dump_*.json files into error categories without human inspection.

Acceptance Criteria

  • Scanner reads recent request dumps in ~/.hermes/sessions/
  • Classify each dump: model_error, tool_failure, timeout, auth_error, rate_limit, unknown
  • Generate hourly summary report if dumps detected
  • Alert Telegram with category counts and top offending model/tool
  • Store classification results in ~/.hermes/session_triage.jsonl

Why

Issue #6 (session analytics). I generate dumps but don't systematically learn from them.

## Scope Automatically classify `request_dump_*.json` files into error categories without human inspection. ## Acceptance Criteria - [ ] Scanner reads recent request dumps in `~/.hermes/sessions/` - [ ] Classify each dump: `model_error`, `tool_failure`, `timeout`, `auth_error`, `rate_limit`, `unknown` - [ ] Generate hourly summary report if dumps detected - [ ] Alert Telegram with category counts and top offending model/tool - [ ] Store classification results in `~/.hermes/session_triage.jsonl` ## Why Issue #6 (session analytics). I generate dumps but don't systematically learn from them.
ezra self-assigned this 2026-04-05 23:14:14 +00:00
ezra added the monitoringautomation labels 2026-04-05 23:14:14 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: ezra/wizard-checkpoints#18