Skip to content

Commit

Permalink
Merge pull request #114 from MeshkatShB/feature/read-base-url-ollama
Browse files Browse the repository at this point in the history
feat: add base_url to ChatOllama to read from remote server
  • Loading branch information
warmshao authored Jan 15, 2025
2 parents 319a6c8 + 332eeab commit 453dd43
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/utils/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,7 @@ def get_llm_model(provider: str, **kwargs):
model=kwargs.get("model_name", "qwen2.5:7b"),
temperature=kwargs.get("temperature", 0.0),
num_ctx=128000,
base_url=kwargs.get("base_url", "http://localhost:11434"),
)
elif provider == "azure_openai":
if not kwargs.get("base_url", ""):
Expand Down

0 comments on commit 453dd43

Please sign in to comment.