AI Model rate limiting #210
Description
Feature request
Add rate limiting to AI endpoints.
The Groq free API allows for 30 requests per minute for many models. It would be nice to be able to configure a default request rate.
{{ message }}
Add rate limiting to AI endpoints.
The Groq free API allows for 30 requests per minute for many models. It would be nice to be able to configure a default request rate.