Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

We experienced ~1 minute latency while sending messages to EventHub from the upstream application on 30.01.2021, and that continued for ~10 minutes. #18936

Closed
koustavnaharoy-ayla opened this issue Feb 2, 2021 · 8 comments
Assignees
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Event Hubs needs-author-feedback Workflow: More information is needed from author to address the issue. no-recent-activity There has been no recent activity on this issue. pillar-performance The issue is related to performance, one of our core engineering pillars. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that

Comments

@koustavnaharoy-ayla
Copy link

Query/Question
We experienced ~1 minute latency while sending messages to EventHub from the upstream application on 30.01.2021, and that continued for ~10 minutes.

Why is this not a Bug or a feature Request?
A clear explanation of why is this not a bug or a feature request?
As per the previous discussion with AZURE support colleague from Microsoft, there was a suggestion came to integrate with the newer azure sdk, azure-messaging-eventhubs 5.3.1 instead of using azure sdk 2.1.0. But that did not yield any visible results.

Setup (please complete the following information if applicable):

  • OS: Kubenetes
  • IDE : IntelliJ
  • Version of the Library used: 5.3.1

Information Checklist
Kindly make sure that you have added all the following information above and checkoff the required fields otherwise we will treat the issuer as an incomplete report

  • [✓] Query Added
  • [✓] Setup information Added
@ghost ghost added needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. customer-reported Issues that are reported by GitHub users external to the Azure organization. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels Feb 2, 2021
@ghost ghost removed the needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. label Feb 3, 2021
@joshfree joshfree added Client This issue points to a problem in the data-plane of the library. Event Hubs needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. labels Feb 3, 2021
@ghost ghost removed the needs-triage Workflow: This is a new issue that needs to be triaged to the appropriate team. label Feb 3, 2021
@joshfree
Copy link
Member

joshfree commented Feb 3, 2021

Hi @koustavnaharoy-ayla can you share more details on the specifics of the application (or logs / traces) so we can better assist
Are you able to reproduce the latency issue using the azure-messaging-eventhubs 5.3.1 SDK? You mentioned a support colleague, do you have an open support ticket (opened through the Azure Portal)? If so, that would be the best channel for working with support directly.

Thanks

@joshfree joshfree added the pillar-performance The issue is related to performance, one of our core engineering pillars. label Feb 3, 2021
@walt-ayla
Copy link

walt-ayla commented Feb 9, 2021

@joshfree The Azure Support team pointed us to you. They are not seeing any issues on the Azure side.

@koustavnaharoy-ayla
Copy link
Author

Hi @koustavnaharoy-ayla can you share more details on the specifics of the application (or logs / traces) so we can better assist
Are you able to reproduce the latency issue using the azure-messaging-eventhubs 5.3.1 SDK? You mentioned a support colleague, do you have an open support ticket (opened through the Azure Portal)? If so, that would be the best channel for working with support directly.

Thanks

@joshfree Yes, we are getting the latency issue even with the the azure-messaging-eventhubs 5.3.1 SDK

@conniey
Copy link
Member

conniey commented Feb 9, 2021

@koustavnaharoy-ayla @walt-ayla Thanks for reporting this issue. Without more details, it's impossible to diagnose. Can you provide:

  1. Enable logging in the Azure SDK. Steps are: https://github.com/Azure/azure-sdk-for-java/wiki/Logging-with-Azure-SDK
  2. Provide a small repro.
  3. Details of your Event Hubs set-up? (ie. how many partitions, throughput units, etc?)

@walt-ayla
Copy link

@conniey For #3. We do not control the EventHub in Azure. That belongs to our customer. The Event Hub azure support team has looked at it and is a appropriately configured. Their research has shown it is not on the Azure side.

I can give you the contact we were working with if you would like to contact them.

@conniey
Copy link
Member

conniey commented Feb 9, 2021

@conniey For #3. We do not control the EventHub in Azure. That belongs to our customer. The Event Hub azure support team has looked at it and is a appropriately configured. Their research has shown it is not on the Azure side.

I wanted to ask about the details to see if I could provide the same set-up locally, but not necessary. 1 and 2 are the important ones.

@walt-ayla
Copy link

@conniey Here is the Event Hub configuration the events are being sent to:
Region= Canada Central
Throughput Units = 2 units
Auto-Inflate throughput = 4 units

@ramya-rao-a ramya-rao-a added needs-author-feedback Workflow: More information is needed from author to address the issue. and removed customer-response-expected labels Feb 22, 2021
@ghost ghost added the no-recent-activity There has been no recent activity on this issue. label Mar 2, 2021
@ghost
Copy link

ghost commented Mar 2, 2021

Hi, we're sending this friendly reminder because we haven't heard back from you in a while. We need more information about this issue to help address it. Please be sure to give us your input within the next 7 days. If we don't hear back from you within 14 days of this comment the issue will be automatically closed. Thank you!

@ghost ghost closed this as completed Mar 16, 2021
@github-actions github-actions bot locked and limited conversation to collaborators Apr 12, 2023
This issue was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. Event Hubs needs-author-feedback Workflow: More information is needed from author to address the issue. no-recent-activity There has been no recent activity on this issue. pillar-performance The issue is related to performance, one of our core engineering pillars. question The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Projects
None yet
Development

No branches or pull requests

5 participants