Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improvements on GC scheduler shutdown #51414

Closed
wants to merge 1 commit into from
Closed

improvements on GC scheduler shutdown #51414

wants to merge 1 commit into from

Conversation

d-netto
Copy link
Member

@d-netto d-netto commented Sep 21, 2023

Likely less disruptive than #51061.

Needs further performance assessment.

@d-netto d-netto force-pushed the dcn-gc-sched branch 3 times, most recently from 758605b to 59bbd8a Compare September 21, 2023 06:48
@KristofferC KristofferC added the backport 1.10 Change should be backported to the 1.10 release label Sep 21, 2023
@brenhinkeller brenhinkeller added the GC Garbage collector label Sep 21, 2023
@d-netto d-netto force-pushed the dcn-gc-sched branch 12 times, most recently from 312bc30 to bab2f63 Compare September 23, 2023 20:26
@d-netto d-netto requested a review from kpamnany September 25, 2023 14:22
@d-netto d-netto force-pushed the dcn-gc-sched branch 4 times, most recently from 103316e to 4e2aaf5 Compare September 26, 2023 21:36
@d-netto d-netto marked this pull request as draft September 27, 2023 13:38
@KristofferC KristofferC mentioned this pull request Oct 3, 2023
31 tasks
@gbaraldi
Copy link
Member

@d-netto what is the state of this?

@d-netto
Copy link
Member Author

d-netto commented Oct 17, 2023

Mostly stale.

As discussed in the GC meeting today, I was only able to reproduce #51044 when oversubscribing the machine I was running on.

I think this PR might not be necessary to avoid negative scaling in the GC as long as the user creates a suitable number of GC threads.

@d-netto
Copy link
Member Author

d-netto commented Oct 17, 2023

(e.g, ngcthreads <= ncores)

KristofferC added a commit that referenced this pull request Nov 2, 2023
Backported PRs:
- [x] #50932 <!-- types: fix hash values of Vararg -->
- [x] #50975 <!-- Use rr-safe `nopl; rdtsc` sequence -->
- [x] #50989 <!-- fix incorrect results in `expm1(::Union{Float16,
Float32})` -->
- [x] #51284 <!-- Avoid infinite loop when doing SIGTRAP in arm64-apple
-->
- [x] #51332 <!-- Add s4 field to Xoshiro -->
- [x] #51397 <!-- call Pkg precompile hook in latest world -->
- [x] #51405 <!-- Remove fallback that assigns a module to inlined
frames. -->
- [x] #51491 <!-- Throw clearer ArgumentError for strip with two string
args -->
- [x] #51531 <!-- fix `_tryonce_download_from_cache` (busybox.exe
download error) -->
- [x] #51541 <!-- Fix string index error in tab completion code -->
- [x] #51530 <!-- Don't mark nonlocal symbols as hidden -->
- [x] #51557 <!-- Fix last startup & shutdown precompiles -->
- [x] #51512 <!-- avoid limiting Type{Any} to Type -->
- [x] #51595 <!-- reset `maxprobe` on `empty!` -->
- [x] #51582 <!-- Aggressive constprop in LinearAlgebra.wrap -->
- [x] #51592 <!-- correctly track element pointer in heap snapshot -->
- [x] #51326 <!-- complete false & true more generally as vals -->
- [x] #51376 <!-- make `hash(::Xoshiro)` compatible with `==` -->
- [x] #51557 <!-- Fix last startup & shutdown precompiles -->
- [x] #51845 
- [x] #51840 
- [x] #50663 <!-- Fix Expr(:loopinfo) codegen -->
- [x] #51863 <!-- LLVM 15.0.7-9 -->

Contains multiple commits, manual intervention needed:

- [ ] #51035 <!-- refactor GC scanning code to reflect jl_binding_t are
now first class -->
- [ ] #51092 <!-- inference: fix bad effects for recursion -->

Non-merged PRs with backport label:
- [ ] #51479 <!-- prevent code loading from lookin in the versioned
environment when building Julia -->
- [ ] #51414 <!-- improvements on GC scheduler shutdown -->
- [ ] #51366 <!-- Handle infix operators in REPL completion -->
- [ ] #50919 <!-- Code loading: do the "skipping mtime check for stdlib"
check regardless of the value of `ispath(f)` -->
- [ ] #50824 <!-- Add some aliasing warnings to docstrings for mutating
functions in Base -->
- [ ] #49805 <!-- Limit TimeType subtraction to AbstractDateTime -->
@KristofferC KristofferC mentioned this pull request Nov 6, 2023
39 tasks
@d-netto d-netto closed this Nov 24, 2023
@KristofferC KristofferC removed the backport 1.10 Change should be backported to the 1.10 release label Nov 27, 2023
gbaraldi pushed a commit that referenced this pull request Dec 5, 2023
Supersedes #51061 and
#51414.

Still needs more perf analysis.
@vtjnash vtjnash deleted the dcn-gc-sched branch December 5, 2023 18:18
KristofferC pushed a commit that referenced this pull request Dec 12, 2023
Supersedes #51061 and
#51414.

Still needs more perf analysis.

(cherry picked from commit e26c257)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
GC Garbage collector
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants