llm request maximum timeout

[Guy-David-Siftt-AI]

Hello Google-ADK community,

I’m trying to increase the LLM request timeout while using the Google-ADK Python SDK v1.13.0.

I noticed the GenerateContentConfig.http_options.timeout parameter can be configured like this:

types.GenerateContentConfig(
    http_options=types.HttpOptions(
        timeout=600_000  # 10 minutes
    )
)

However, despite setting the timeout to 10 minutes, the maximum I can achieve is about 5 minutes before the request times out.

Has anyone encountered this limitation or found a reliable workaround to extend the timeout beyond 5 minutes?

BTW im getting

aiohttp.client_exceptions.ClientOSError: [Errno 54] Connection reset by peer

[adk-bot]

Response from ADK Answering Agent (experimental, answer may be inaccurate)

TLDR: The Gemini API, which is used by the ADK, has a server-side request timeout of 5 minutes. This is why you are observing the timeout, even when you configure a longer timeout in the client-side SDK.

---

Hello @Guy-David-Siftt-AI,

Thank you for your question.

The behavior you are observing is expected. While you can configure a longer timeout in the ADK Python SDK, the underlying Gemini API has a maximum request timeout of 5 minutes. If a request to the API takes longer than 5 minutes to complete, the connection is terminated by the server, which results in the Connection reset by peer error you are seeing. [1]

Therefore, even if you set a timeout of 10 minutes in the http_options, the request will still fail after 5 minutes due to this server-side limitation.

At the moment, there is no known workaround to extend this timeout beyond 5 minutes as it is a hard limit on the service side.

[1] https://ai.google.dev/gemini-api/docs/llms.txt