Replace obsolete docker-compose package used to run system tests

[cmacknz]

The currently obsolete docker-compose package used to run system tests recently caused all tests to fail when the version of docker in our CI runners was upgraded. A work around was used to get around this by forking the upstream package. See #38743 and https://github.com/pkoutsovasilis/compose. We need to get rid of the forked version of https://github.com/pkoutsovasilis/compose.

Switching our compose implementation https://github.com/gabrieldemarmiesse/python-on-whales seems like the easiest path at present. We could also manually rewrite the compose client to shell out the command line, or take on the entire task of rewriting the system tests in Go.

Several WIP PRs switching to Python on Whales were started by need to be continued:

• [WIP] Replace docker-compose by python-on-whales #38678
• [Not for merge] Testing CI fixes #38699

This is the class we need to rewrite:

beats/libbeat/tests/system/beat/compose.py

Lines 20 to 41 in 5b0b682

	class ComposeMixin(object):
	"""
	Manage docker-compose to ensure that needed services are running during tests
	"""
	# List of required services to run INTEGRATION_TESTS
	COMPOSE_SERVICES = []
	# Additional environment variables for docker compose
	COMPOSE_ENV = {}
	# timeout waiting for health (seconds)
	COMPOSE_TIMEOUT = 300
	# add advertised host environment file
	COMPOSE_ADVERTISED_HOST = False
	# port to advertise when COMPOSE_ADVERTISED_HOST is set to true
	COMPOSE_ADVERTISED_PORT = None
	@classmethod
	def compose_up(cls):

[elasticmachine]

Pinging @elastic/elastic-agent (Team:Elastic-Agent)