[gemini] feat: Add Claude API fallback tier to cascade.py (#980) #1119
Reference in New Issue
Block a user
Delete Branch "gemini/issue-980"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
This PR adds a
cascade_tierparameter to thecompletemethod inCascadeRouter. Whencascade_tieris set tofrontier_required, the router will only use theanthropicprovider. This allows for a fallback to a more powerful model for high-stakes tasks, while still using local models for the majority of requests.Fixes #980