Structured output doesn't work with open ai endpoint

[Stealthwriter]

System Info

response_format doesn't work with open ai endpoint, please add it

Information

• Docker
• The CLI directly

Tasks

• An officially supported command
• My own modifications

Reproduction

just run a normal server and send a request with a structured response to the open ai endpoint

Expected behavior

it should return a structured output like what I define

[Trofleb]

Hello, I have a PR for just that fix if you want to take a look: #2954.