Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Event Hubs] Revisit load-balancing algorithm initialization #6108

Closed
chradek opened this issue Nov 7, 2019 · 1 comment · Fixed by #9706
Closed

[Event Hubs] Revisit load-balancing algorithm initialization #6108

chradek opened this issue Nov 7, 2019 · 1 comment · Fixed by #9706
Assignees
Labels
Client This issue points to a problem in the data-plane of the library. Event Hubs
Milestone

Comments

@chradek
Copy link
Contributor

chradek commented Nov 7, 2019

Currently, EventProcessor will grab 1 partition at a time during load-balancing. Depending on the number of processors, it can take a long time before all partitions are assigned a processor.

Another strategy was to take all available partitions and allow other processors to steal as necessary.

@chradek chradek added Client This issue points to a problem in the data-plane of the library. Event Hubs labels Nov 7, 2019
@triage-new-issues triage-new-issues bot removed the triage label Nov 7, 2019
@ramya-rao-a ramya-rao-a added this to the [2020] January milestone Nov 8, 2019
@richardpark-msft
Copy link
Member

Customer has a case where their initialization per partition is expensive so stealing and constantly cycling partitions hurts their performance. This makes the greedy approach a non-starter for their use-case.

@chradek chradek modified the milestones: [2020] March, [2020] April Mar 9, 2020
@chradek chradek removed their assignment Mar 9, 2020
@chradek chradek modified the milestones: [2020] April, [2020] May Apr 1, 2020
@ramya-rao-a ramya-rao-a modified the milestones: [2020] May, [2020] June Apr 24, 2020
@ramya-rao-a ramya-rao-a modified the milestones: [2020] June, Backlog May 1, 2020
@ramya-rao-a ramya-rao-a modified the milestones: Backlog, [2020] July Jun 10, 2020
@chradek chradek self-assigned this Jun 18, 2020
@github-actions github-actions bot locked and limited conversation to collaborators Apr 12, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Client This issue points to a problem in the data-plane of the library. Event Hubs
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants