Cleanup the "extended load test" overrides

[mm4tt]

The extended load tests has been implemented and enabled everywhere as a part of #704.
We've been running these tests in many places (also at 5k node scales) for a few months. I believe we have enough confidence to make all the changes the defaults and cleanup all the gating logic we have.

We should get rid of all these overrides: https://github.com/kubernetes/perf-tests/tree/master/clusterloader2/testing/load/experimental/overrides
And clean-up all places where they are used (e.g. 10+ occurrences in k8s.io/test-infra)

[mm4tt]

/good-first-issue

[k8s-ci-robot]

@mm4tt:
This request has been marked as suitable for new contributors.

Please ensure the request meets the requirements listed here.

If this request no longer meets these requirements, the label can be removed
by commenting with the /remove-good-first-issue command.

In response to this:

/good-first-issue

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[wojtek-t]

To clarify - the things to do are:

• update default for things that are enabled everywhere (PVs are still disabled in couple tests)
• then remove the overwrides
• cleanup ability to override those things

[maniSbindra]

Hi @wojtek-t I would like to work on this issue.

I found 126 occurrences of "testing/load/experimental/override" in 7 files within k8s.io/test-infra. All these occurrences use --test-cmd-args=--testoverrides=./testing/load/experimental/overrides/ with one of the files listed in https://github.com/kubernetes/perf-tests/tree/master/clusterloader2/testing/load/experimental/overrides .

I wanted a bit more clarification regarding changes and tests I can use to verify the changes. So as apart of PR to resolve this issue should I

• Remove the --test-cmd-args=--testoverrides=./testing/load/experimental/overrides/ switches from k8s.io/test-infra ?
• Remove the override files ?
• Modify the ./clusterloader2/pkg/config/template_provider.go to cleanup ability to override
  ?
• Would it be possible to share more details related to "update default for things that are enabled everywhere"

Thanks,
Mani

[mm4tt]

Hey @maniSbindra, thanks for taking a look at this!

To give you an example of what "update defaults" means, let's take a look at the
https://github.com/kubernetes/perf-tests/blob/master/clusterloader2/testing/load/experimental/overrides/enable_configmaps.yaml
It overrides the ENABLE_CONFIGMAPS variable to true.
We'd like to change the default of ENABLE_CONFIGMAPS to true so the override is not needed anymore. To do that, you should find all places where this variable is defined and change the default to true, e.g. this one

perf-tests/clusterloader2/testing/load/config.yaml

Line 20 in d818473

{{$ENABLE_CONFIGMAPS := DefaultParam .ENABLE_CONFIGMAPS false}}

Once you do that, the override will be no-op and it will be safe to delete it (first delete usage in test-infra, then delete the override file in perf-test).

[maniSbindra]

Thank you @mm4tt. I will work on this.