feat(lb): Introduce the ability to load balance on composite keys in lb

[dhftah]

Right now, there's a problem at high throughput using the load balancer and the service.name resource attribute: The load balancers themself get slow. While it's possible to vertically scale them to a point (e.g. about 100k req/sec), as they get slow they star tot back up traffic and block on requests. Applications then can't write as many spans out, and start dropping spans.

This commit seeks to address that by extending the load balancing collector to allow create a composite from attributes that can still keep the load balancing decision "consistent enough" to reduce cardinallity, but still spread the load across ${N} collectors.

It doesn't make too many assumptions about how the operators will use this, except that the underlying data (the spans) are unlikely to be complete in all cases, and the key generation is "best effort". This is a deviation from the existing design, in which hard-requires "span.name".

== Design Notes
=== Contributor Skill

As a contributor, I'm very much new to the opentelemetry collector, and do not anticipate I will be contributing much except for as needs require to tune the collectors that I am responsible for. Given this, the code may violate certain assumptions that are otherwise "well known".

=== Required Knowledge

The biggest surprise in this code was that despite accepting a slice, the routingIdentifierFromTraces function assumes spans have been processed with the batchpersignal.SplitTraces() function, which appears to ensure taht each "trace" contains only a single span (thus allowing them to be multiplexed effectively)

This allows the function to be simplified quite substantially.

=== Use case

The primary use case I am thinking about when writing this work is calculating metrics in the spanmetricsconnector component. Essentially, services drive far too much traffic for a single collector instance to handle, so we need to multiplex it in a way that still allows them to be calculated in a single place (limiting cardinality) but also, spreads the load across ${N} collectors.

=== Traces only implementation

This commit addreses this only for traces, as I only care about traces. The logic can likely be extended easily, however.

[jpkrohling]

I did a first pass, and there's a concern around the assumption that there's is only one span per trace in the batches, which I'm not sure is correct. In any case, I understand this change is being battle tested and I'm interested in hearing more once the results are available.

[jpkrohling]

Apart from the linting failures, this LGTM.

@dhftah, would you please include a changelog entry for this?

[github-actions]

This PR was marked stale due to lack of activity. It will be closed in 14 days.

[github-actions]

Closed as inactive. Feel free to reopen if this PR is still being worked on.

[jpkrohling]

This PR has been opened from a main branch. The history of this scared me for a moment, as it kind of implies that I force-pushed to this repo's main branch, which isn't the case :-) I'm opening a new PR based on this PR.