vominh1919 5401a0080d fix: recalculate token budgets on model switch in ContextCompressor ...

update_model() recalculated threshold_tokens but left tail_token_budget
and max_summary_tokens at their __init__ values. When switching from a
200K model to 32K, the tail budget stayed at ~20K tokens (62% of 32K)
instead of the intended ~10%.

Adds budget recalculation in update_model() and 2 regression tests.

2026-04-25 15:07:56 +05:30

45 KiB

Raw Blame History

View Raw