Check out and ignore docs/Manifest.toml #25

Triggered via pull request February 23, 2024 16:55

LilithHafner

opened #7

lh/docs

Status Cancelled

Total duration 9m 20s

Artifacts –

CI.yml

on: pull_request

Documentation

1m 44s

Matrix: test

Annotations

4 errors, 24 warnings, and 1 notice

Documentation: src/public.jl#L91

doctest failure in ~/work/Chairmarks.jl/Chairmarks.jl/src/public.jl:91-115 ```jldoctest; filter = r"\d+", setup = :(using Random) julia> @b rand(10000) # Benchmark a function 5.833 μs (2 allocs: 78.172 KiB) julia> @b rand hash # How long does it take to hash a random Float64? 1.757 ns julia> @b rand(1000) sort issorted(_) || error() # Simultaneously benchmark and test 11.291 μs (3 allocs: 18.062 KiB) julia> @b rand(1000) sort! issorted(_) || error() # BAD! This repeatedly resorts the same array! 1.309 μs (0.08 allocs: 398.769 bytes) julia> @b rand(1000) sort! issorted(_) || error() evals=1 # Specify evals=1 to ensure the function is only run once between setup and teardown 10.041 μs (2 allocs: 10.125 KiB) julia> @b rand(10) _ sort!∘rand! issorted(_) || error() # Or, include randomization in the benchmarked function and only allocate once 120.536 ns julia> @b (x = 0; for _ in 1:50; x = hash(x); end; x) # We can use arbitrary expressions in any position in the pipeline, not just simple functions. 183.871 ns julia> @b (x = 0; for _ in 1:5e8; x = hash(x); end; x) # This runs for a long time, so it is only run once (with no warmup) 2.447 s (without a warmup) ``` Subexpression: @b rand(1000) sort! issorted(_) || error() # BAD! This repeatedly resorts the same array! Evaluated output: 2.103 μs (0.11 allocs: 576 bytes) Expected output: 1.309 μs (0.08 allocs: 398.769 bytes) diff = Warning: Diff output requires color. 1.309 2.103 μs (0.08 (0.11 allocs: 398.769 576 bytes)

Documentation: src/public.jl#L133

doctest failure in ~/work/Chairmarks.jl/Chairmarks.jl/src/public.jl:133-186 ```jldoctest; filter = r"\d+|evaluations?|, \d+\.\d+% gc time|max \d+\.\d+ ..", setup = :(using Random) julia> @be rand(10000) # Benchmark a function Benchmark: 267 samples with 2 evaluations min 8.500 μs (2 allocs: 78.172 KiB) median 10.354 μs (2 allocs: 78.172 KiB) mean 159.639 μs (2 allocs: 78.172 KiB, 0.37% gc time) max 39.579 ms (2 allocs: 78.172 KiB, 99.93% gc time) julia> @be rand hash # How long does it take to hash a random Float64? Benchmark: 4967 samples with 10805 evaluations min 1.758 ns median 1.774 ns mean 1.820 ns max 5.279 ns julia> @be rand(1000) sort issorted(_) || error() # Simultaneously benchmark and test Benchmark: 2689 samples with 2 evaluations min 9.771 μs (3 allocs: 18.062 KiB) median 11.562 μs (3 allocs: 18.062 KiB) mean 14.933 μs (3 allocs: 18.097 KiB, 0.04% gc time) max 4.916 ms (3 allocs: 20.062 KiB, 99.52% gc time) julia> @be rand(1000) sort! issorted(_) || error() # BAD! This repeatedly resorts the same array! Benchmark: 2850 samples with 13 evaluations min 1.647 μs (0.15 allocs: 797.538 bytes) median 1.971 μs (0.15 allocs: 797.538 bytes) mean 2.212 μs (0.15 allocs: 800.745 bytes, 0.03% gc time) max 262.163 μs (0.15 allocs: 955.077 bytes, 98.95% gc time) julia> @be rand(1000) sort! issorted(_) || error() evals=1 # Specify evals=1 to ensure the function is only run once between setup and teardown Benchmark: 6015 samples with 1 evaluation min 9.666 μs (2 allocs: 10.125 KiB) median 10.916 μs (2 allocs: 10.125 KiB) mean 12.330 μs (2 allocs: 10.159 KiB, 0.02% gc time) max 6.883 ms (2 allocs: 12.125 KiB, 99.56% gc time) julia> @be rand(10) _ sort!∘rand! issorted(_) || error() # Or, include randomization in the benchmarked function and only allocate once Benchmark: 3093 samples with 237 evaluations min 121.308 ns median 126.055 ns mean 128.108 ns max 303.447 ns julia> @be (x = 0; for _ in 1:50; x = hash(x); end; x) # We can use arbitrary expressions in any position in the pipeline, not just simple functions. Benchmark: 3387 samples with 144 evaluations min 183.160 ns median 184.611 ns mean 188.869 ns max 541.667 ns julia> @be (x = 0; for _ in 1:5e8; x = hash(x); end; x) # This runs for a long time, so it is only run once (with no warmup) Benchmark: 1 sample with 1 evaluation 2.488 s (without a warmup) ``` Subexpression: @be rand(1000) sort! issorted(_) || error() # BAD! This repeatedly resorts the same array! Evaluated output: Benchmark: 1844 samples with 18 evaluations min 2.121 μs (0.11 allocs: 576 bytes) median 2.359 μs (0.11 allocs: 576 bytes) mean 2.401 μs (0.11 allocs: 577.789 bytes) max 4.679 μs (0.11 allocs: 689.778 bytes) Expected output: Benchmark: 2850 samples with 13 evaluations min 1.647 μs (0.15 allocs: 797.538 bytes) median 1.971 μs (0.15 allocs: 797.538 bytes) mean 2.212 μs (0.15 allocs: 800.745 bytes, 0.03% gc time) max 262.163 μs (0.15 allocs: 955.077 bytes, 98.95% gc time) diff = Warning: Diff output requires color. Benchmark: 2850 1844 samples with 13 18 evaluations min 1.647 2.121 μs (0.15 (0.11 allocs: 797.538 576 bytes) median 1.971 2.359 μs (0.15 (0.11 allocs: 797.538 576 bytes) mean 2.212 2.401 μs (0.15 (0.11 allocs: 800.745 bytes, 0.03% gc time) 577.789 bytes) max 262.163 4.679 μs (0.15 (0.11 allocs: 955.077 bytes, 98.95% gc time)689.778 bytes)

Documentation

Process completed with exit code 1.

Julia 1.6 - windows-latest - x64 - pull_request

The run was canceled by @LilithHafner.

Julia 1 - ubuntu-latest - x64 - pull_request

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, julia-actions/setup-julia@v1, actions/cache@4d4ae6ae148a43d0fd1eda1800170683e9882738, pyTooling/Actions/with-post-step@adef08d3bdef092282614f3b683897cefae82ee3, codecov/codecov-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Julia 1 - ubuntu-latest - x64 - pull_request

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, codecov/codecov-action@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

Julia nightly - ubuntu-latest - x64 - pull_request

Julia 1 - macOS-latest - x64 - pull_request

Documentation

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v2, julia-actions/setup-julia@v1. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Documentation

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

Julia 1 - windows-latest - x64 - pull_request