[Task][prism]: Be able to execute non-Go SDKs on Prism.

[lostluck]

Backlink to global prism tracking issue: #29650

What needs to happen?

Umbrella task for tracking PRs to improve prism and get it to support non-go SDKs.

More targeted tasks should be filed for other work items, and linked here.

This includes

• Improving error output for Prism to make SDK or prism side failures clearer.
  • With rare exceptions, prism no longer crashes on certain failures, allowing errors to return to the calling runners. Other issues are around specific failure clarity that will be handled on a case by case basis.
• Improve general debugging capabilities for Prism.
  • Execution time panics converted to errors to simplify user test output.
  • Stage descriptor building time panics converted to errors to simplify user test output.
  • Gracefully shutting down worker GRPC server to reduce spurious noise from SDKs.
• Docker environment support. [DONE [#28187] Prism docker env support. #28444]
• Cross language / multiple environment support [DONE [#28187][prism] Basic cross language support. #28545].
• [Task] Publish Prism binary (os + architecture combos) artifacts on Beam Release. #29697
• [Task][prism] Have java wrapper check and download released prism binary if available. #31402
  • [Task][Prism]: Create a PrismRunner for Java. #31793
  • Run Java Validates Runner tests on Prism
    • Validates Runner Test Control file https://github.com/apache/beam/blob/master/runners/portability/java/build.gradle
  • Java Runner Wrapper to execute a job against Prism (via Go being available) for dev versions
• [Task][prism] Have python wrapper check and download released prism binary if available. #31403
  • [#28187] Add gradle targets to execute python tests with prism. #32637
  • Python Runner Wrapper to execute a job against Prism (via Go being available) for dev versions #32877

[lostluck]

I think the final trick: Being able to have Java build a prism instance for you via a Go invocation is possible, but I don't know exactly how to test it presently, because Java development set ups are esoteric by nature.

Technically it would live in PrismLocator.java, and replicate the logic in the Python command here:

https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/prism_runner.py#L204

That is, roughly: "if the Beam version is a development version, then we use Go to try and and install build prism directly to the cache, and fail out if there's no Go, or there's a compile error".