Overview
Recent models from OpenAI support explicit caching: https://developers.openai.com/api/docs/guides/prompt-caching#prompt-cache-breakpoints
Motivation
Can it improve caching?
Use cases
No response
Proposed solution
No response
Alternatives
No response
Related issues
No response
Additional context
No response
Overview
Recent models from OpenAI support explicit caching: https://developers.openai.com/api/docs/guides/prompt-caching#prompt-cache-breakpoints
Motivation
Can it improve caching?
Use cases
No response
Proposed solution
No response
Alternatives
No response
Related issues
No response
Additional context
No response