Rockachopa/Timmy-time-dashboard
1
0
Fork 2
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

[P2] Research sovereignty metrics + dashboard tracking #981

New Issue
Closed
opened 2026-03-22 19:08:54 +00:00 by perplexity · 2 comments
perplexity commented 2026-03-22 19:08:54 +00:00
Collaborator
Copy Link

Parent

  • #972 — [GOVERNING] Replacing Claude — Autonomous Research Pipeline Spec

Objective

Track research sovereignty progress against the graduation targets defined in the spec.

Metrics to Track

Metric Week 1 Month 1 Month 3 Graduation
Research queries answered locally 10% 40% 80% >90%
API cost per research task $1.50 $0.50 $0.10 <$0.01
Time from question to report 3 hours 30 min 5 min <1 min
Human involvement per task 100% Review only Approve only None
Research artifacts in local index 6 30+ 100+ Comprehensive

Scope

  • Emit metrics from ResearchOrchestrator: cache_hit_rate, api_cost, time_to_report, human_involvement
  • Feed into metrics emitter (#954) from Sovereignty Loop
  • Dashboard widget showing trend over time
  • Alert when API cost exceeds threshold

Graduation Test

Timmy receives a Gitea issue asking for state-of-the-art evaluation. Timmy searches local knowledge, identifies gap, formulates queries, searches web, fetches pages, synthesizes report, commits to repo, creates follow-up issues, indexes result — all without a single message to Claude or any human.

Effort Estimate

4 hours

Related

  • #954 — Metrics emitter (Sovereignty Loop)
  • #962 — Three-strike anomaly detector
## Parent - #972 — [GOVERNING] Replacing Claude — Autonomous Research Pipeline Spec ## Objective Track research sovereignty progress against the graduation targets defined in the spec. ## Metrics to Track | Metric | Week 1 | Month 1 | Month 3 | Graduation | |--------|--------|---------|---------|------------| | Research queries answered locally | 10% | 40% | 80% | >90% | | API cost per research task | $1.50 | $0.50 | $0.10 | <$0.01 | | Time from question to report | 3 hours | 30 min | 5 min | <1 min | | Human involvement per task | 100% | Review only | Approve only | None | | Research artifacts in local index | 6 | 30+ | 100+ | Comprehensive | ## Scope - Emit metrics from ResearchOrchestrator: cache_hit_rate, api_cost, time_to_report, human_involvement - Feed into metrics emitter (#954) from Sovereignty Loop - Dashboard widget showing trend over time - Alert when API cost exceeds threshold ## Graduation Test Timmy receives a Gitea issue asking for state-of-the-art evaluation. Timmy searches local knowledge, identifies gap, formulates queries, searches web, fetches pages, synthesizes report, commits to repo, creates follow-up issues, indexes result — **all without a single message to Claude or any human.** ## Effort Estimate 4 hours ## Related - #954 — Metrics emitter (Sovereignty Loop) - #962 — Three-strike anomaly detector
claude self-assigned this 2026-03-22 23:37:40 +00:00
perplexity commented 2026-03-23 13:53:09 +00:00
Author
Collaborator
Copy Link

📋 Triage: Infrastructure — Deprioritized

Dashboard/UI layer. The harness is the product — dashboard work is secondary.

Ref: #1076

📋 **Triage: Infrastructure — Deprioritized** Dashboard/UI layer. The harness is the product — dashboard work is secondary. Ref: #1076
claude added the deprioritizedinfrastructure labels 2026-03-23 13:56:22 +00:00
claude commented 2026-03-23 14:08:51 +00:00
Collaborator
Copy Link

PR created. Added sovereignty metrics tracking with SQLite-backed store, dashboard panel on Mission Control, API cost alert system, and event bus integration. 5 metrics tracked against graduation targets (cache_hit_rate, api_cost, time_to_report, human_involvement, local_artifacts). 17 tests, all passing.

PR created. Added sovereignty metrics tracking with SQLite-backed store, dashboard panel on Mission Control, API cost alert system, and event bus integration. 5 metrics tracked against graduation targets (cache_hit_rate, api_cost, time_to_report, human_involvement, local_artifacts). 17 tests, all passing.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
222-epic
Workshop: Timmy as Presence (Epic #222)
 actionable
Has a concrete code/config task extracted
 assigned-claude
Issue currently assigned to Claude agent — do not assign to another agent
 assigned-gemini
Issue currently assigned to Gemini agent — do not assign to another agent
 assigned-groq
assigned-kimi
Issue currently assigned to Kimi agent — do not assign to another agent
 assigned-manus
Issue currently assigned to Manus agent — do not assign to another agent
 claude-ready
consolidation
Part of a consolidation epic
 deprioritized
Keep open but not blocking P0 work
 deprioritized
Keep open but not blocking P0 work
 duplicate
Duplicate of another issue
 gemini-review
Auto-generated by Gemini, needs relevance review
 groq-ready
harness
Core product: agent framework, heartbeat, inference, memory
 heartbeat
Harness: Agent heartbeat loop
 inference
Harness: Inference and model routing
 infrastructure
Supporting stage: dashboard, CI/CD, deployment, DNS
 kimi-ready
Scoped and ready for Kimi to pick up
 memory-session
Harness: Memory and session crystallization
 morrowind
Harness: Morrowind embodiment
 needs-design
Needs architectural design before implementation
 needs-extraction
Philosophy with unextracted engineering work
 p0-critical
Priority 0: Must fix now
 p1-important
Priority 1: Important, next sprint
 p2-backlog
Priority 2: Backlog, do when time permits
 philosophy
Philosophical foundation — informs architecture decisions
 rejected-direction
Closed: rejected or superseded direction
 seed:know-purpose
Three Seeds: KNOW YOUR PURPOSE
 seed:serve-real
Three Seeds: SERVE THE REAL
 seed:tell-truth
Three Seeds: TELL THE TRUTH
 sovereignty
Harness: Sovereignty stack
No Label deprioritized infrastructure
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Timmy claude grok groq kimi manus perplexity Rockachopa
No Assignees claude
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Rockachopa/Timmy-time-dashboard#981
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?