Add a Pipeline option that sets desired logging level for logs produced by runners.

[kennknowles]

In some cases BEAM users or runner maintainers may want to increase the logging level produced by the BEAM runners. To make it simpler, SDK should capture a desired logging level in PipelineOptions and pass it on to runners.

For comparison, we have instrumentation that captures logging for Java SDK harness[1]. It seems that we should have similar option that captures logging granularity on the runner side.
[1]

beam/sdks/java/core/src/main/java/org/apache/beam/sdk/options/SdkHarnessOptions.java

Line 62 in 2b4a6b5

LogLevel getDefaultSdkHarnessLogLevel();

Imported from Jira BEAM-3178. Original Jira may contain additional context.
Reported by: tvalentyn.

[Abacn]

.close-issue this was the same as #18222