-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve scheduling algorithm for better throughput #249
Comments
It should already be doing that: Lines 368 to 373 in a27ef61
However, there are a few problems (or were, last time I looked):
|
shonfeder
changed the title
Improve scheduling algorithm
Improve scheduling algorithm to improve throughput
Sep 24, 2024
shonfeder
changed the title
Improve scheduling algorithm to improve throughput
Improve scheduling algorithm for better throughput
Oct 2, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
We often see the current scheduling to result in one worker getting overloaded with a massive queue due to cache hints while other workers are starved for work.
We want the job scheduling algorithm to take cache hints into account, but also to consider worker capacity and availability. There are times where this should be able to really improve our thru put.
Related to, but more general than #168
The text was updated successfully, but these errors were encountered: