Did anybody connect ADK to a Cloudflare AI Gateway?

[charlyalv]

I tried it with my Cloudflare Gateway configuration but ADK is still asking me for an OpenAI API KEY

[adk-bot]

Response from ADK Answering Agent (experimental, answer may be inaccurate)

TLDR: To connect ADK to a Cloudflare AI Gateway, you need to use the LiteLlm model wrapper and set the OPENAI_API_BASE environment variable to your Cloudflare Gateway URL. You will also need to set the OPENAI_API_KEY environment variable, but it can be set to any non-empty string.

---

Hello! I see you're having trouble connecting ADK to your Cloudflare AI Gateway. The issue you're encountering is likely due to the ADK not being configured to point to your custom endpoint, and thus defaulting to the OpenAI provider which requires a valid API key.

ADK is model-agnostic and can be connected to any OpenAI-compatible endpoint, such as Cloudflare AI Gateway, by using the LiteLlm wrapper and configuring the correct environment variables. [1]

Here are the steps to get it working:

1. Use the LiteLlm Wrapper in Your Agent

In your agent's code, you need to import LiteLlm and use it as the model for your agent. You can specify the model you are using behind the gateway (e.g., an OpenAI model).

from google.adk.agents import Agent
from google.adk.models.lite_llm import LiteLlm

root_agent = Agent(
    model=LiteLlm(model="openai/gpt-4o"),  # Or any other model served by your gateway
    name="my_agent",
    description="An agent using Cloudflare AI Gateway",
    # ... other agent parameters
)

2. Set the Environment Variables

You need to set the OPENAI_API_BASE environment variable to your Cloudflare AI Gateway endpoint URL. When using a custom OPENAI_API_BASE, you also need to set OPENAI_API_KEY, but it can be any non-empty string. [3]

export OPENAI_API_BASE="YOUR_CLOUDFLARE_GATEWAY_URL"
export OPENAI_API_KEY="any-string-will-work"

Replace "YOUR_CLOUDFLARE_GATEWAY_URL" with the actual URL of your Cloudflare AI Gateway.

By following these steps, ADK will send requests to your Cloudflare Gateway instead of the default OpenAI endpoint, and you should no longer be prompted for an OpenAI API key.

Let me know if you have any other questions!

[1] Using Different Models with ADK (https://google.github.io/adk-docs/agents/models/)
[3] README (https://github.com/google/adk-python/blob/main/contributing/samples/hello_world_ollama/README.md)

[charlyalv]

Im still getting: litellm.exceptions.AuthenticationError: litellm.AuthenticationError: AuthenticationError: OpenAIException - Incorrect API key provided: any-stri********work. You can find your API key at https://platform.openai.com/account/api-keys.