Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support structured output when using Ollama as the model provider #3836

Open
2 tasks done
JiangJiaWei1103 opened this issue Jan 24, 2025 · 0 comments
Open
2 tasks done
Assignees
Labels
area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension "needs-triage" priority:medium Indicates medium priority

Comments

@JiangJiaWei1103
Copy link

Validations

  • I believe this is a way to improve. I'll try to join the Continue Discord for questions
  • I'm not able to find an open issue that requests the same enhancement

Problem

Ollama supports structured output, allowing a model’s output format to be constrained by a defined JSON schema. It would be fantastic to have support for this feature here as well.

Solution

Based on my observation of the source code here, it seems this feature is planned but not currently a top priority. I’d be happy to discuss this feature further and assist in bringing it to life. Thanks!

@dosubot dosubot bot added area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension priority:medium Indicates medium priority labels Jan 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:configuration Relates to configuration options kind:enhancement Indicates a new feature request, imrovement, or extension "needs-triage" priority:medium Indicates medium priority
Projects
None yet
Development

No branches or pull requests

2 participants