Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dummy PR to do a PkgEval run #37214

Closed
wants to merge 1 commit into from
Closed

Dummy PR to do a PkgEval run #37214

wants to merge 1 commit into from

Conversation

KristofferC
Copy link
Member

@KristofferC KristofferC commented Aug 26, 2020

Might as well start with this process now in preparation for 1.6, to see what the state is. Quite a lot has happened since 1.5.

@KristofferC KristofferC added the DO NOT MERGE Do not merge this PR! label Aug 26, 2020
@KristofferC
Copy link
Member Author

@nanosoldier runtests(ALL, vs = ":release-1.5")

@nanosoldier
Copy link
Collaborator

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@KristofferC
Copy link
Member Author

KristofferC commented Aug 27, 2020

This is a rough outline of the failures (number to the left is number of packages).

70: still uncategorized
58: parameter_upper_bounds removal (mostly seems to be from old Colors versions)
37: Changes to llvmcall
35: Various printing changes
32: IRTools broken
15: doctest failures (mostly printing changes)
12: Cassette broken
7: bounds error in compiler (#37182)
7: new ambiguities
5: GPU problems
5: New syntax error: #37228
3: People doing "bad stuff"
3: @inferred failures
2: @approx error
2: Test.detect_ambiguities

If anyone is interested in helping out they can look at https://github.com/KristofferC/PkgEvalAnalysis/blob/master/analysis.ipynb for how I tend to do it.

@timholy
Copy link
Member

timholy commented Aug 27, 2020

We just tagged a bunch of packages that fixed some printing-test failures on nightly.

@JeffBezanson
Copy link
Member

Wow, this was amazingly (depressingly?) useful.

@KristofferC
Copy link
Member Author

Rebased on master:

@nanosoldier runtests(ALL, vs = ":release-1.5")

@maleadt
Copy link
Member

maleadt commented Sep 7, 2020

Nanosoldier process died, let's try again:

@nanosoldier runtests(ALL, vs = ":release-1.5")

@nanosoldier
Copy link
Collaborator

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@KristofferC
Copy link
Member Author

Some updates: https://github.com/KristofferC/PkgEvalAnalysis/blob/master/analysis.ipynb

 (84, PrintingChange)
 (47, Unknown)
 (39, IRTools)
 (28, LLVMModuleIR)
 (26, TestAmbiguities)
 (17, DocTest)
 (14, GPUErrors)
 (13, Cassette)
 (13, InferenceStackOverFlow)
 (12, BadBoy)
 (9, NewAmbiguity)
 (8, BoundsErrorCompiler)
 (4, NewExceptionType)
 (2, UnexpectedPass)
 (2, DownloadError)
 (2, ApproxError)
 (2, InferredFailure)

@KristofferC

This comment has been minimized.

@nanosoldier
Copy link
Collaborator

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@KristofferC
Copy link
Member Author

@nanosoldier runtests(ALL, vs = ":release-1.5")

@nanosoldier
Copy link
Collaborator

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@maleadt
Copy link
Member

maleadt commented Nov 13, 2020

This one might be interesting too:

@nanosoldier runtests(ALL, vs = ":release-1.5", buildflags=["USE_BINARYBUILDER_LLVM=0", "LLVM_ASSERTIONS=1", "FORCE_ASSERTIONS=1"])

@nanosoldier
Copy link
Collaborator

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@KristofferC
Copy link
Member Author

CSV + some other packages should be fixed now.

@nanosoldier runtests(ALL, vs = ":release-1.5", buildflags=["USE_BINARYBUILDER_LLVM=0", "LLVM_ASSERTIONS=1", "FORCE_ASSERTIONS=1"])

@nanosoldier
Copy link
Collaborator

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@KristofferC
Copy link
Member Author

Checking if master is in an ok shape to branch.

@nanosoldier runtests(ALL, vs = ":release-1.5")

@nanosoldier
Copy link
Collaborator

Something went wrong when running your job:

NanosoldierError: failed to run tests: Build for julia on x86_64-linux-gnu did not complete successfully

Logs and partial data can be found here
cc @maleadt

@KristofferC
Copy link
Member Author

@nanosoldier runtests(ALL, vs = ":release-1.5")

@nanosoldier
Copy link
Collaborator

nanosoldier commented Dec 8, 2020

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@maleadt
Copy link
Member

maleadt commented Dec 8, 2020

Let's see if some of these segfault are due to a failed assertion:

@nanosoldier runtests(ALL, vs = ":release-1.5", buildflags=["USE_BINARYBUILDER_LLVM=0", "LLVM_ASSERTIONS=1", "FORCE_ASSERTIONS=1"])

@nanosoldier
Copy link
Collaborator

nanosoldier commented Dec 8, 2020

Your package evaluation job has completed - possible new issues were detected. A full report can be found here. cc @maleadt

@KristofferC KristofferC closed this Dec 9, 2020
@maleadt maleadt deleted the kc/nanosoldier_test branch December 9, 2020 11:50
@DilumAluthge DilumAluthge removed the DO NOT MERGE Do not merge this PR! label Jun 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants