Feat: Allow to configure kubelet root directory

[apten-fors]

This pull request introduces a new configuration option KubeletRootDir to specify the root directory for the kubelet base directory. The changes include updates to the cluster policy types, CRD manifests, controllers, and tests to support this new configuration.

Configuration Enhancements:

• Added KubeletRootDir field to the HostPathsSpec struct in api/nvidia/v1/clusterpolicy_types.go to represent the kubelet base directory.
• Updated CRD manifests (bundle/manifests/nvidia.com_clusterpolicies.yaml, config/crd/bases/nvidia.com_clusterpolicies.yaml, deployments/gpu-operator/crds/nvidia.com_clusterpolicies.yaml) to include the new KubeletRootDir field.

Controller Updates:

• Added DefaultKubeletRootDir constant and updated preProcessDaemonSet function in controllers/object_controls.go to transform the kubelet root directory if a custom one is configured. [1] [2]
• Implemented transformForKubeletRootDir function in controllers/object_controls.go to apply necessary transformations for custom kubelet root directory.

Testing:

• Added TestTransformForKubeletRootDir function in controllers/transforms_test.go to validate the transformations for different kubelet root directory configurations.

Deployment Configuration:

• Updated deployments/gpu-operator/templates/clusterpolicy.yaml and deployments/gpu-operator/values.yaml to include the new kubeletRootDir configuration. [1] [2]

Closes #1358
Closes #745

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[xiaoyao]

Good job!