[BIG-BRAIN] Auto-stop pod when idle (cost control) #577

Open
opened 2026-04-07 15:55:37 +00:00 by Timmy · 0 comments
Owner

Goal

Implement a cost control mechanism so the L40S pod ($0.79/hr) automatically stops when no inference has been made in the last N minutes.

Why this matters

At $0.79/hr, forgetting the pod for 24 hours = $19. We need an idle watchdog.

Design

  • Cron job (every 15 min) checks last request timestamp from Ollama logs or a local file
  • If idle > 30 minutes, call RunPod podStop mutation via API
  • Log the stop event with reason
  • On next Hermes session that requests big_brain, auto-resume the pod and wait for it to come back up

Acceptance Criteria

  • Idle watchdog cron job running on Mac
  • Test: idle 31 min → pod stops, verify via GraphQL API
  • Test: request to big_brain endpoint → pod auto-resumes before responding
  • Cost log showing stop/start events with timestamps
## Goal Implement a cost control mechanism so the L40S pod ($0.79/hr) automatically stops when no inference has been made in the last N minutes. ## Why this matters At $0.79/hr, forgetting the pod for 24 hours = $19. We need an idle watchdog. ## Design - Cron job (every 15 min) checks last request timestamp from Ollama logs or a local file - If idle > 30 minutes, call RunPod `podStop` mutation via API - Log the stop event with reason - On next Hermes session that requests big_brain, auto-resume the pod and wait for it to come back up ## Acceptance Criteria - [ ] Idle watchdog cron job running on Mac - [ ] Test: idle 31 min → pod stops, verify via GraphQL API - [ ] Test: request to big_brain endpoint → pod auto-resumes before responding - [ ] Cost log showing stop/start events with timestamps
Timmy added this to the Big Brain Showcase — RunPod L40S Operational milestone 2026-04-07 15:55:37 +00:00
ezra was assigned by Timmy 2026-04-08 15:16:26 +00:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: Timmy_Foundation/timmy-home#577