feat: Sovereign Efficiency — Local-First & Cost Optimization #226
Reference in New Issue
Block a user
Delete Branch "feat/cost-saving-guide"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
This PR implements the "Local-First & Cost Saving" story by enabling Smart Model Routing (routing simple tasks to Gemma 2B), enabling Context Compression to save KV cache, and adding a comprehensive guide for resource stewardship.