Update EventHub to enable live testing in sovereign clouds for multiple services

[v-xuto]

These changes enable Event Hub to run live tests against Public, UsGov and China.

@benbp , @jameszliao-msft , @lmazuel , @lilyjma , @ramya-rao-a, @annatisch for notification.

[yunhaoling]

/azp run python - eventhub - tests

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

Tests skipped

[v-xuto]

@yunhaoling @benbp I rerun a new weekly pipeline, test(test_auth.py::test_client_secret_credential) failed in UsGov and China clouds. Error is: Unauthorized access. 'Send' claim(s) are required to perform this operation. For more details please check here. How do we solve the question of permissions Azure Event Hubs Data Sender?

[benbp]

@v-xuto you may need to add another RBAC policy in the ARM template test-resources.json file? However some quick internet searching indicates that this error may be misleading, and it's actually a missing password? https://stackoverflow.com/a/68833937

I would try adding the claim first in this array and see if that fixes the issue: https://github.com/Azure/azure-sdk-for-python/blob/main/sdk/eventhub/test-resources.json#L189-L215

The role id can be found here and is 2b629674-e913-4c01-ae53-ef4638d8f975.

[v-xuto]

@benbp I run this test(test_auth.py::test_client_secret_credential) locally, and I also encounter the same permission problem. So, I debug the test code and set the breakpoint after the eventhub and other resources are created. After the resources are created, I go to the portal to find the corresponding eventhub and add permissions(Azure Event Hubs Data Sender) to it, and continue to run the test. The test result is PASS.
I'm not sure if this will help the same issue we encountered on the weekly pipeline.

[v-xuto]

@benbp What is your progress on this issue (Unauthorized access. 'Send' claim(s) are required to perform this operation.)?

[benbp]

@v-xuto sorry for the delay I was on vacation. Have you tried updating the RBAC assignments in the ARM template similar to the examples I linked?

[v-xuto]

@benbp I have tried updating the RBAC assignments in the ARM template, it still reports the same error. For more details please check here.
Through investigation, I think this issue may be because it uses ARM template + PowerShellPreparer to deploy resources, some using MgmtClient while some using ARM template. When using MgmtClient to create services, there is no Azure Event Hubs Data Ownerpermission added here.

@yunhaoling Any ideas about this issue(Unauthorized access. 'Send' claim(s) are required to perform this operation)?

[v-xuto]

@benbp @swathipil Now, rerun the Event Hub weekly pipeline, there is a new issue here.

When running tests(test_send.py::test_send_with_partition_key and its async test ) in windows2019_36 on China cloud, test failed and the error message is: uamqp.errors.ConnectionClose: ErrorCodes.UnknownError: Connection in an unexpected error state. For more details please check here.

Do you have any ideas to solve this issue?

[swathipil]

/azp run python - eventhub - tests

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[swathipil]

/azp run python - eventhub - tests

[azure-pipelines]

No pipelines are associated with this pull request.

[swathipil]

/azp run python - eventhub - tests

[swathipil]

/azp run python - eventhub - ci

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[azure-pipelines]

Azure Pipelines successfully started running 1 pipeline(s).

[swathipil]

green EH tests-weekly pipeline: https://dev.azure.com/azure-sdk/internal/_build/results?buildId=2613023&view=results

[ghost]

Hello @swathipil!

Because this pull request has the auto-merge label, I will be glad to assist with helping to merge this pull request once all check-in policies pass.

p.s. you can customize the way I help with merging this pull request, such as holding this pull request until a specific person approves. Simply @mention me (@msftbot) and give me an instruction to get started! Learn more here.

[ghost]

Apologies, while this PR appears ready to be merged, I've been configured to only merge when all checks have explicitly passed. The following integrations have not reported any progress on their checks and are blocking auto-merge:

1. Azure Pipelines

These integrations are possibly never going to report a check, and unblocking auto-merge likely requires a human being to update my configuration to exempt these integrations from requiring a passing check.

Give feedback on this

From the bot dev team

We've tried to tune the bot such that it posts a comment like this only when auto-merge is blocked for exceptional, non-intuitive reasons. When the bot's auto-merge capability is properly configured, auto-merge should operate as you would intuitively expect and you should not see any spurious comments.

Please reach out to us at [email protected] to provide feedback if you believe you're seeing this comment appear spuriously. Please note that we usually are unable to update your bot configuration on your team's behalf, but we're happy to help you identify your bot admin.