Enrich metrics with more metadata

[gazal-k]

Summary

Metrics collected and exported by the OTeL collectors here have some attributes around the k8s context, but misses important attributes like the deployment / daemonset / statefulset that the Pod is associated with 😞

Here are the attributes for container_cpu_usage_seconds_total metric:

Traces on the other hand have a lot more metadata, such as:

k8s.cluster.name
k8s.container.name
k8s.deployment.name
k8s.namespace.name
k8s.node.name
k8s.pod.ip
k8s.pod.name
k8s.pod.start_time
k8s.pod.uid
k8s.replicaset.name

There also seems to be inconsistency in the attributes names. For example, namespace attribute in metrics vs k8s.namespace.name in traces.

Desired Behavior

Richer metadata association on metrics, similar to traces, and consistent attribute names.

Possible Solution

Additional context