API documentation

Cache measurements

October 9, 2026. Text-only synthetic requests with a connected account. Observed results; not a guaranteed provider TTL.

Target pauseConversationObserved pause (s)Input tokensCached tokensCache shareRequest ID
1mcontinued60.0200601945696.99%chatcmpl-861a7497-2453-4c27-b0ad-046bed1cde5e
1mfresh60.0200461945697.06%chatcmpl-9532d697-4762-4627-a5fd-683d5272687b
5mcontinued300.0200611945696.98%chatcmpl-9682c309-fcdd-4c13-97fa-9de37767e1c4
5mfresh300.1200471945697.05%chatcmpl-b0b6ad8d-c3af-4a46-838f-b1605bb2902a

Longer-duration measurements were stopped. A cache hit depends on the model, eligible prefix and provider routing. These samples do not establish a 24-hour provider cache lifetime. Gateway context retention is a separate capability.