Requests per second, is it possible with the SDK?

[ivankatliarchuk]

Hi

We have multiple (dozens) clients (with aws-sdk-go-v2) that making all sorts for requests to AWS Route53, AWS IAM, and to some other services. Clients are not aware of each other, but running in same AWS acccounts, multi tenant environments.

Quite often clients hitting

Throttling: Rate exceeded

We setting up Retryer

cfg, err := config.LoadDefaultConfig(ctx,
		....
		config.WithRetryer(func() aws.Retryer {
			return retry.NewStandard(func(o *retry.StandardOptions) {
				o.MaxAttempts = 3
				o.MaxBackoff = 5 * time.Second
			})
		}),
		....
	)

It works to an extend. I know there is more advanced Rate limiter

cfg, err := config.LoadDefaultConfig(context.Background(), config.WithRetryer(func() aws.Retryer {
    return retry.NewStandard(func(o *retry.StandardOptions) {
        // Makes the rate limiter more permissive in general. These values are
        // arbitrary for demonstration and may not suit your specific
        // application's needs.
        o.RateLimiter = ratelimit.NewTokenRateLimit(1000)
        o.RetryCost = 1
        o.RetryTimeoutCost = 3
        o.NoRetryIncrement = 10
    })
}))

But what we want, is something in between, is it possible to set QPS (queries per seconds) with retryes, something like 5 requests per seconds. With or without Burst.