Julien Talbot 92c19924a9 feat: add xAI prompt caching via x-grok-conv-id header ...

When using xAI's API directly (base_url contains x.ai), send the
x-grok-conv-id header set to the Hermes session_id. This routes
consecutive requests to the same server, maximizing automatic
prompt cache hits.

Ref: https://docs.x.ai/developers/advanced-api-usage/prompt-caching

2026-04-06 12:06:33 -07:00

456 KiB

Raw Blame History

View Raw