Context caching reuses the computation for static prompt prefixes (system prompts, tool definitions, boilerplate context).
Why It Matters
Large static contexts are common in agents. Caching reduces repeated prefill cost and improves latency.
Context Caching
Reuse static prefill (KV cache) to avoid reprocessing large repeated contexts.