[Feat]Support alternative openai compatible llm providers

[sushen123]

What do we need?

Quick Replies currently supports OpenAI, but many openai compatible providers follow the same API format.
To allow flexibility, we need to add a single input field for an OpenAI-compatible API URL. This should work alongside the existing OpenAI API key and model fields without requiring separate configurations.

Acceptance Criteria

• Add a single input field for an open ai compatible api url.
• The existing Openai api key and model fields should be used for openai compatible providers.
• If a custom api url is provided, requests should be directed to it instead of the default OpenAI API.
• Quick Replies should function correctly with alternative providers following OpenAI’s API schema.

Relevant ScreenShots

No response

Further Comments

No response

[sushen123]

hey @VipinDevelops , Is this a valid issue to work on? Since it already supports openai, adding support for open ai compatible providers seems like a useful enhancement.

[iam-vipin]

@sushen123 Could you share doc's or something explaining more about what you are trying to achieve here?
Not able to get your point here.

[sushen123]

@sushen123 Could you share doc's or something explaining more about what you are trying to achieve here? Not able to get your point here.

Right now, Quick Replies only works with OpenAI API, but many AI providers like Together AI, Groq, Fireworks AI, Anyscale, and Google Gemini follow a similar API structure.

That means we could let users switch to a different AI provider just by adding a custom API URL field, without needing separate configurations.

https://api.openai.com/v1/chat/completions
If a user wants to switch to Together AI, they could enter:
https://api.together.xyz/v1/chat/completions in API URL
For Google Gemini, they could enter:
https://generativelanguage.googleapis.com/v1beta/chat/completions

• No extra fields needed for API key or model the existing OpenAI fields will be used.
• Only one additional field for the API base URL.
• No separate Gemini input field is needed it can also use the OpenAI compatible setup.

This way, Quick Replies will support multiple AI providers effortlessly!
The UI will also be clean for the user.
Gemini docs: https://ai.google.dev/gemini-api/docs/openai#rest_2
together ai docs: https://docs.together.ai/reference/chat-completions-1
ollama : https://ollama.com/blog/openai-compatibility

This way user can use choose more llm providers and also it make the ui clean

Let me know if anything you want to talk about

[sushen123]

hey @VipinDevelops , is this valide issue to work on?

[iam-vipin]

@sushen123 You're just adding more LLM support—yeah, that sounds good, but which ones and why those? That's yet to be answered.

[sushen123]

@sushen123 You're just adding more LLM support—yeah, that sounds good, but which ones and why those? That's yet to be answered.

i mean llm provider like together ai, anyscale to have more option for user