[BIG-BRAIN] Auto-stop pod when idle (cost control) #577
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Goal
Implement a cost control mechanism so the L40S pod ($0.79/hr) automatically stops when no inference has been made in the last N minutes.
Why this matters
At $0.79/hr, forgetting the pod for 24 hours = $19. We need an idle watchdog.
Design
podStopmutation via APIAcceptance Criteria