Skip to content

Should we support OpenAI explicit caching #3705

Description

@dgageot

Overview

Recent models from OpenAI support explicit caching: https://developers.openai.com/api/docs/guides/prompt-caching#prompt-cache-breakpoints

Motivation

Can it improve caching?

Use cases

No response

Proposed solution

No response

Alternatives

No response

Related issues

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

area/modelsLLM model integrations and model providersarea/providers/openaiFor features/issues/fixes related to the usage of OpenAI models

Fields

No fields configured for Enhancement.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions