[Enhancement] Plumber to relay messages between BEs

[Tang8330]

What would you like to see added?

A clear and concise description of what you would like to see added to plumber.

Use Case

Right now, Plumber is able to read or write to and from various messaging queues. It would be amazing if Plumber can do both at the same time.

Such that we can run Plumber to do integrations like this:

• Pub/Sub to Kafka
• RabbitMQ to GCP Pub/Sub

Plumber would then be used to fan-in from various messaging queues to one. Thus, cutting the integration time for downstream services and opening up additional use cases.

Proposed Change

Describe the modified behavior or contrast it with existing behavior here.

Ability for Plumber to read from various messaging queues and write to a specified one.

Who Benefits from the Change(s)?

Describe the users or subset of users that could benefit from having this feature.

Downstream applications to be able to integrate with Plumber

Additional context

Add any other context about the request.

[dselans]

Thanks for submitting an issue! We've discussed exactly this sort of functionality in the past and have had several other requests for this.

We're going to brainstorm what this would look like and what it'll take to pull this off.