timmy-home/docs/SCORECARD.md

# Workflow Scorecard

Updated: April 4, 2026

The old overnight `uni-wizard` scorecard is no longer the primary operational metric.
The current scorecard should measure whether Timmy's real workflow is healthy.

## What To Score

### Queue Health

- unassigned issue count
- PRs waiting on Timmy or Allegro review
- overloaded assignees
- duplicate issue / duplicate PR pressure

### Runtime Health

- Hermes gateway reachable
- local provider responding
- latest heartbeat tick present
- model health reporting accurately

### Learning Loop Health

- archive checkpoint advancing
- notes and knowledge artifacts being emitted
- DPO files growing
- freshness lag between sessions and exports

## Suggested Daily Questions

1. Did review keep pace with execution today?
2. Did any builder receive work outside their lane?
3. Did Timmy spend time on judgment rather than routine queue cleanup?
4. Did the private learning pipeline produce usable artifacts?
5. Did any stale doc, helper, or default try to pull the system back into old habits?

## Useful Inputs

- `~/.timmy/heartbeat/ticks_YYYYMMDD.jsonl`
- `~/.timmy/metrics/local_YYYYMMDD.jsonl`
- `~/.timmy/twitter-archive/checkpoint.json`
- `~/.timmy/twitter-archive/metrics/progress.json`
- Gitea open PR queue
- Gitea unassigned issue queue

## Suggested Ratings

### Queue Discipline

- Strong: review and dispatch are keeping up, little duplicate churn
- Mixed: queue moves, but ambiguity or duplication is increasing
- Weak: review is backlogged or agents are being misrouted

### Runtime Reliability

- Strong: heartbeat, Hermes, and provider surfaces all healthy
- Mixed: intermittent downtime or weak health signals
- Weak: major surfaces untrusted or stale

### Learning Throughput

- Strong: checkpoint advances, DPO output accumulates, eval gates are visible
- Mixed: some artifacts land, but freshness or checkpointing lags
- Weak: sessions occur without export, or learning artifacts stall

## The Goal

The point of the scorecard is not to admire activity.
The point is to tell whether the system is becoming more reviewable, more sovereign, and more capable of learning from lived work.