Add hadoop-auth

[ahmedabu98]

Fixes the failing beam_PostCommit_Python_Xlang_IO_Direct and beam_PostCommit_Python_Xlang_IO_Dataflow tests, which are running into the following error after the recent hadoop bump from 2.10.2 --> 3.4.1:

Error stacktrace:

E       RuntimeError: org.apache.beam.sdk.util.UserCodeException: java.lang.NoSuchMethodError: org.apache.hadoop.security.HadoopKerberosName.setRuleMechanism(Ljava/lang/String;)V
E               at org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
E               at org.apache.beam.sdk.io.iceberg.WriteUngroupedRowsToFiles$WriteUngroupedRowsToFilesDoFn$DoFnInvoker.invokeStartBundle(Unknown Source)
E               at org.apache.beam.fn.harness.FnApiDoFnRunner.startBundle(FnApiDoFnRunner.java:804)
E               at org.apache.beam.fn.harness.data.PTransformFunctionRegistry.lambda$register$0(PTransformFunctionRegistry.java:116)
E               at org.apache.beam.fn.harness.control.ProcessBundleHandler.processBundle(ProcessBundleHandler.java:532)
E               at org.apache.beam.fn.harness.control.BeamFnControlClient.delegateOnInstructionRequestType(BeamFnControlClient.java:150)
E               at org.apache.beam.fn.harness.control.BeamFnControlClient$InboundObserver.lambda$onNext$0(BeamFnControlClient.java:115)
E               at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
E               at java.util.concurrent.FutureTask.run(FutureTask.java:266)
E               at org.apache.beam.sdk.util.UnboundedScheduledExecutorService$ScheduledFutureTask.run(UnboundedScheduledExecutorService.java:163)
E               at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
E               at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
E               at java.lang.Thread.run(Thread.java:750)
E       Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.security.HadoopKerberosName.setRuleMechanism(Ljava/lang/String;)V
E               at org.apache.hadoop.security.HadoopKerberosName.setConfiguration(HadoopKerberosName.java:84)
E               at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:314)
E               at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:299)
E               at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:586)
E               at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3888)
E               at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:3878)
E               at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3666)
E               at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:557)
E               at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366)
E               at org.apache.iceberg.hadoop.Util.getFs(Util.java:56)
E               at org.apache.iceberg.hadoop.HadoopCatalog.initialize(HadoopCatalog.java:112)
E               at org.apache.iceberg.CatalogUtil.loadCatalog(CatalogUtil.java:239)
E               at org.apache.iceberg.CatalogUtil.buildIcebergCatalog(CatalogUtil.java:284)
E               at org.apache.beam.sdk.io.iceberg.IcebergCatalogConfig.catalog(IcebergCatalogConfig.java:66)
E               at org.apache.beam.sdk.io.iceberg.WriteUngroupedRowsToFiles$WriteUngroupedRowsToFilesDoFn.getCatalog(WriteUngroupedRowsToFiles.java:213)
E               at org.apache.beam.sdk.io.iceberg.WriteUngroupedRowsToFiles$WriteUngroupedRowsToFilesDoFn.startBundle(WriteUngroupedRowsToFiles.java:221)

[ahmedabu98]

assign set of reviewers

[github-actions]

Assigning reviewers. If you would like to opt out of this review, comment assign to next reviewer:

R: @damondouglas for label java.
R: @damccorm for label build.
R: @damondouglas for label io.

Available commands:

• stop reviewer notifications - opt out of the automated review tooling
• remind me after tests pass - tag the comment author after tests pass
• waiting on author - shift the attention set back to the author (any comment or push by the author will return the attention set to the reviewers)

The PR bot will only process comments in the main thread (not review comments).

[damccorm]

Thanks!