Skip to content

Latest commit

 

History

History
9 lines (6 loc) · 6 KB

deploymentstreaminvokeoptions.md

File metadata and controls

9 lines (6 loc) · 6 KB

DeploymentStreamInvokeOptions

Fields

Field Type Required Description
include_retrievals Optional[bool] Whether to include the retrieved knowledge chunks in the response.
mock_response Optional[str] A mock response to use instead of calling the LLM API. This is useful for testing purposes. When provided, the system will return a response object with this content as the completion, without making an actual API call to the LLM provider. This works for both streaming and non-streaming requests. Mock responses will not generate logs, traces or be counted for your plan usage.