You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was trying to use these models today while generating structured output with OpenaiChatModel. But, I ran into issues as these models do not support the same range of parameters as older models like gpt-4. Thus magentic breaks quite heavily.
Notably, the o1 models don't:
support to set max_tokens (aside from setting it to 1)
allow the parallel_tool_calls parameter
support tools
The text was updated successfully, but these errors were encountered:
Right now all structured output in magentic uses tool calls which these models don't support. o1 (but not o1-mini I think) supports openai's structured outputs, which magentic should really be using in the case where a single structured output is desired (no union in return type and no functions provided). Issue for that is #295 Apart from that, I think we just have to wait for openai to add support for tools. The parallel_tool_calls and max_tokens parameters could be optionally omitted.
Hi,
I was trying to use these models today while generating structured output with
OpenaiChatModel
. But, I ran into issues as these models do not support the same range of parameters as older models like gpt-4. Thus magentic breaks quite heavily.Notably, the o1 models don't:
max_tokens
(aside from setting it to 1)parallel_tool_calls parameter
tools
The text was updated successfully, but these errors were encountered: