Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

investigate Updating checkpoint interval defaults #25039

Closed
conniey opened this issue Oct 26, 2021 · 0 comments · Fixed by #26715
Closed

investigate Updating checkpoint interval defaults #25039

conniey opened this issue Oct 26, 2021 · 0 comments · Fixed by #26715
Assignees
Labels
bug This issue requires a change to an existing behavior in the product in order to be resolved. Client This issue points to a problem in the data-plane of the library. Event Hubs

Comments

@conniey
Copy link
Member

conniey commented Oct 26, 2021

from @jsquire's investigation in .NET, to change our current defaults:

  • Default load balancing strategy: Greedy (currently Balanced)
  • Default ownership interval: 2 minutes (currently 30 seconds)
  • Default load balancing interval: 30 seconds (currently 10 seconds)

Currently, you'd have to set these manually:

        EventProcessorClientBuilder eventProcessorClientBuilder = new EventProcessorClientBuilder()
             ...
            .loadBalancingStrategy(LoadBalancingStrategy.GREEDY)
            .partitionOwnershipExpirationInterval(Duration.ofMinutes(2))
            .loadBalancingUpdateInterval(Duration.ofSeconds(30));

Based on his investigations,

"the root cause of the load balancing cycle in the processor not performing quickly enough to retain ownership, leading to partitions bouncing around and being orphaned for a period of time.
These seem to be caused by Storage operations having latency and/or requiring retries, the host machine being under-provisioned leading to contention in the thread pool when scheduling continuations, or both.

@conniey conniey added Event Hubs Client This issue points to a problem in the data-plane of the library. labels Oct 26, 2021
@conniey conniey self-assigned this Oct 26, 2021
@conniey conniey added the bug This issue requires a change to an existing behavior in the product in order to be resolved. label Oct 26, 2021
@conniey conniey added this to the [2022] February milestone Jan 18, 2022
@github-actions github-actions bot locked and limited conversation to collaborators Apr 11, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug This issue requires a change to an existing behavior in the product in order to be resolved. Client This issue points to a problem in the data-plane of the library. Event Hubs
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant