Add geolocation to object store config

[pauldg]

To allow for smarter job scheduling a mechanism for tracking geographical location of object stores and compute destinations, allowing the job scheduling decision process (eg through TPV) to choose compute resources with “nearby” storage. This would especially be relevant in the context of #14073 , #15875 and the EuroScienceGateway project.

[bgruening]

@pauldg lets at first try out what information we need as an annotation. For example we could put next to the TPV configfiles a simple mapping file that maps object-store-IDs to geolocations/IPs etc ...
Simple as:

object_store_italy_S3_01:
- latitude="50.0689816"
- longitude="19.9070188"
- other_stuff_that_we_find_useful: foobar

TPV can then read this small mapping file and we can experiment with different implementations. When we have a better feeling what might work and what not we could then proceed to move it into Galaxy, e.g. like https://github.com/usegalaxy-eu/infrastructure-playbook/pull/656/files#diff-892ad16ab91d143f9c5b8360026aa9f8e7f4c833c25760e26bf29a5624e095c3R167

Do you think this is a good short-term solution? We can keep this issue open and come back later and update with concreate examples.

[pauldg]

Yes, starting from the TPV side of things seems like a good approach as well.

[hexylena]

is lat/lon more useful? i would've expected AS numbers, or better yet a "path cost" would be more useful to describe the path between the central server and the data, and between various compute nodes and data storage. e.g. you'd have a cost of 0 within the DC. You could probably populate that pretty easily via pinging every other node to generate those costs

[bgruening]

We do not know yet, AS will be tested, as well as HOPs etc... I guess we need to experiment with the file and try different things.

[hexylena]

ttl, yes also good. physical location should only matter at distances of continents, within country/EU DC-DC connections should predominate and depends more on their peering

[pauldg]

Here's a small PoC using lon/lat added to tpv's pytest suite: galaxyproject/total-perspective-vortex#108