Support for Third-Party LLMs (Llama, Mistral etc.)

[korkridake]

While Azure OpenAI is the default recommendation within the GPT-RAG repo, what steps should I take, let say, if somebody prefers to use LLama or Mistral models hosted through the Azure Model Catalog? How should I configure it? I couldn't find a guide and would love to get your thoughts and recommendations.