feat: add local-vs-cloud token and throughput metrics #85

Merged
Timmy merged 1 commits from feat/issue-76-local-cloud-metrics into main 2026-03-28 14:24:12 +00:00
Owner

Summary

  • add metrics_helpers.py for token estimation, throughput, and session sovereignty summaries
  • record estimated local input/output tokens plus latency/tok-s in tasks.py local metrics logs
  • surface local throughput and local-vs-cloud token estimates in bin/timmy-dashboard
  • restore the local llama.cpp default in config.yaml so the local story stays true in config as well

Test Plan

  • python3 -m pytest tests/test_metrics_helpers.py -q
  • python3 -m pytest tests -q
  • python3 bin/timmy-dashboard --hours=1

Proof

Dashboard now shows concrete local/cloud load lines such as:

  • Token est: 0 local | 70500 cloud
  • Est cloud cost: $0.7050
  • local throughput / token counters when local calls succeed

Refs #76
Refs #73

## Summary - add `metrics_helpers.py` for token estimation, throughput, and session sovereignty summaries - record estimated local input/output tokens plus latency/tok-s in `tasks.py` local metrics logs - surface local throughput and local-vs-cloud token estimates in `bin/timmy-dashboard` - restore the local llama.cpp default in `config.yaml` so the local story stays true in config as well ## Test Plan - `python3 -m pytest tests/test_metrics_helpers.py -q` - `python3 -m pytest tests -q` - `python3 bin/timmy-dashboard --hours=1` ## Proof Dashboard now shows concrete local/cloud load lines such as: - `Token est: 0 local | 70500 cloud` - `Est cloud cost: $0.7050` - local throughput / token counters when local calls succeed Refs #76 Refs #73
Timmy added 1 commit 2026-03-28 14:24:10 +00:00
Timmy merged commit 34e01f0986 into main 2026-03-28 14:24:12 +00:00
Timmy deleted branch feat/issue-76-local-cloud-metrics 2026-03-28 14:24:13 +00:00
Sign in to join this conversation.