Skip to content

Commit

Permalink
Merge pull request #656 from LuxDL/compathelper/new_version/2024-05-1…
Browse files Browse the repository at this point in the history 
…8-00-58-48-891-01015869638

CompatHelper: bump compat for OptimizationOptimJL to 0.3 for package GravitationalWaveForm, (keep existing compat)
  • Loading branch information
@avik-pal
avik-pal authored May 18, 2024
2 parents 09118bc + 95f85fb commit 6724ac9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/GravitationalWaveForm/Project.toml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,6 @@ Lux = "0.5"
LuxAMDGPU = "0.2"
LuxCUDA = "0.3"
Optimization = "3"
OptimizationOptimJL = "0.1, 0.2"
OptimizationOptimJL = "0.1, 0.2, 0.3"
OrdinaryDiffEq = "6"
SciMLSensitivity = "7.57"

1 comment on commit 6724ac9

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Benchmark Results

Benchmark suite Current: 6724ac9 Previous: 09118bc Ratio
Dense(2 => 2)/cpu/reverse/ReverseDiff (compiled)/(2, 128) 3646.875 ns 4238 ns 0.86
Dense(2 => 2)/cpu/reverse/Zygote/(2, 128) 7337 ns 7259.6 ns 1.01
Dense(2 => 2)/cpu/reverse/Tracker/(2, 128) 20659 ns 21220 ns 0.97
Dense(2 => 2)/cpu/reverse/ReverseDiff/(2, 128) 9922.4 ns 9663 ns 1.03
Dense(2 => 2)/cpu/reverse/Flux/(2, 128) 8968.8 ns 9034.8 ns 0.99
Dense(2 => 2)/cpu/reverse/SimpleChains/(2, 128) 4472.777777777777 ns 4487.25 ns 1.00
Dense(2 => 2)/cpu/reverse/Enzyme/(2, 128) 1194.792 ns 1198.046511627907 ns 1.00
Dense(2 => 2)/cpu/forward/NamedTuple/(2, 128) 1181.446153846154 ns 1120.8645161290322 ns 1.05
Dense(2 => 2)/cpu/forward/ComponentArray/(2, 128) 1199.5669291338584 ns 1196.6612903225807 ns 1.00
Dense(2 => 2)/cpu/forward/Flux/(2, 128) 1810.7111111111112 ns 1807.78 ns 1.00
Dense(2 => 2)/cpu/forward/SimpleChains/(2, 128) 179.7208387942333 ns 179.3059805285118 ns 1.00
Dense(20 => 20)/cpu/reverse/ReverseDiff (compiled)/(20, 128) 17262 ns 17352 ns 0.99
Dense(20 => 20)/cpu/reverse/Zygote/(20, 128) 17212 ns 17763 ns 0.97
Dense(20 => 20)/cpu/reverse/Tracker/(20, 128) 37130 ns 37781 ns 0.98
Dense(20 => 20)/cpu/reverse/ReverseDiff/(20, 128) 28464 ns 28503 ns 1.00
Dense(20 => 20)/cpu/reverse/Flux/(20, 128) 19657 ns 20148 ns 0.98
Dense(20 => 20)/cpu/reverse/SimpleChains/(20, 128) 16771 ns 16751 ns 1.00
Dense(20 => 20)/cpu/reverse/Enzyme/(20, 128) 4375.428571428572 ns 4369.571428571428 ns 1.00
Dense(20 => 20)/cpu/forward/NamedTuple/(20, 128) 3893.625 ns 3919.75 ns 0.99
Dense(20 => 20)/cpu/forward/ComponentArray/(20, 128) 3971.125 ns 3997.375 ns 0.99
Dense(20 => 20)/cpu/forward/Flux/(20, 128) 4957.857142857143 ns 5062.428571428572 ns 0.98
Dense(20 => 20)/cpu/forward/SimpleChains/(20, 128) 1674.1 ns 1654.1 ns 1.01
Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 3, 128) 38480623 ns 38893589 ns 0.99
Conv((3, 3), 3 => 3)/cpu/reverse/Zygote/(64, 64, 3, 128) 57341801 ns 57747282 ns 0.99
Conv((3, 3), 3 => 3)/cpu/reverse/Tracker/(64, 64, 3, 128) 69371616.5 ns 76441253 ns 0.91
Conv((3, 3), 3 => 3)/cpu/reverse/ReverseDiff/(64, 64, 3, 128) 88450140 ns 88909219 ns 0.99
Conv((3, 3), 3 => 3)/cpu/reverse/Flux/(64, 64, 3, 128) 72172285 ns 72355304 ns 1.00
Conv((3, 3), 3 => 3)/cpu/reverse/SimpleChains/(64, 64, 3, 128) 11559136 ns 11931186 ns 0.97
Conv((3, 3), 3 => 3)/cpu/reverse/Enzyme/(64, 64, 3, 128) 17834505.5 ns 8462724 ns 2.11
Conv((3, 3), 3 => 3)/cpu/forward/NamedTuple/(64, 64, 3, 128) 7000169 ns 7039280 ns 0.99
Conv((3, 3), 3 => 3)/cpu/forward/ComponentArray/(64, 64, 3, 128) 6947691.5 ns 6989814 ns 0.99
Conv((3, 3), 3 => 3)/cpu/forward/Flux/(64, 64, 3, 128) 10454678.5 ns 9960054 ns 1.05
Conv((3, 3), 3 => 3)/cpu/forward/SimpleChains/(64, 64, 3, 128) 6378637 ns 6380476.5 ns 1.00
vgg16/cpu/reverse/Zygote/(32, 32, 3, 16) 694999119 ns 722806750 ns 0.96
vgg16/cpu/reverse/Zygote/(32, 32, 3, 64) 2866181480 ns 2835540372 ns 1.01
vgg16/cpu/reverse/Zygote/(32, 32, 3, 2) 146506305 ns 151219245.5 ns 0.97
vgg16/cpu/reverse/Tracker/(32, 32, 3, 16) 750476425 ns 756623569 ns 0.99
vgg16/cpu/reverse/Tracker/(32, 32, 3, 64) 2630716964 ns 2571716919 ns 1.02
vgg16/cpu/reverse/Tracker/(32, 32, 3, 2) 194373986.5 ns 188283653 ns 1.03
vgg16/cpu/reverse/Flux/(32, 32, 3, 16) 668768664 ns 739225130 ns 0.90
vgg16/cpu/reverse/Flux/(32, 32, 3, 64) 2748635953 ns 2739243286 ns 1.00
vgg16/cpu/reverse/Flux/(32, 32, 3, 2) 126367600 ns 127884020 ns 0.99
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 16) 171806597.5 ns 172755154 ns 0.99
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 64) 643804572 ns 648925285 ns 0.99
vgg16/cpu/forward/NamedTuple/(32, 32, 3, 2) 34225276 ns 34627462 ns 0.99
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 16) 164495340.5 ns 163891804 ns 1.00
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 64) 638843409 ns 641272488 ns 1.00
vgg16/cpu/forward/ComponentArray/(32, 32, 3, 2) 29998420 ns 29854983 ns 1.00
vgg16/cpu/forward/Flux/(32, 32, 3, 16) 209772045.5 ns 188534215 ns 1.11
vgg16/cpu/forward/Flux/(32, 32, 3, 64) 737830459 ns 739638354.5 ns 1.00
vgg16/cpu/forward/Flux/(32, 32, 3, 2) 35348717 ns 35604603.5 ns 0.99
Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 64, 128) 1014087442 ns 1202513999.5 ns 0.84
Conv((3, 3), 64 => 64)/cpu/reverse/Zygote/(64, 64, 64, 128) 1862523552 ns 1878808739 ns 0.99
Conv((3, 3), 64 => 64)/cpu/reverse/Tracker/(64, 64, 64, 128) 1942536155 ns 2005770056 ns 0.97
Conv((3, 3), 64 => 64)/cpu/reverse/ReverseDiff/(64, 64, 64, 128) 2376143676 ns 2358798832.5 ns 1.01
Conv((3, 3), 64 => 64)/cpu/reverse/Flux/(64, 64, 64, 128) 1820279354.5 ns 1946328060 ns 0.94
Conv((3, 3), 64 => 64)/cpu/reverse/Enzyme/(64, 64, 64, 128) 558114089 ns 347541503.5 ns 1.61
Conv((3, 3), 64 => 64)/cpu/forward/NamedTuple/(64, 64, 64, 128) 317173844.5 ns 323363680 ns 0.98
Conv((3, 3), 64 => 64)/cpu/forward/ComponentArray/(64, 64, 64, 128) 319028319.5 ns 328914512 ns 0.97
Conv((3, 3), 64 => 64)/cpu/forward/Flux/(64, 64, 64, 128) 349899561 ns 357889235 ns 0.98
Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 1, 128) 11883092 ns 11784712 ns 1.01
Conv((3, 3), 1 => 1)/cpu/reverse/Zygote/(64, 64, 1, 128) 17732015 ns 17800778 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/Tracker/(64, 64, 1, 128) 19004948 ns 19110943 ns 0.99
Conv((3, 3), 1 => 1)/cpu/reverse/ReverseDiff/(64, 64, 1, 128) 23822815.5 ns 23917192 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/Flux/(64, 64, 1, 128) 17804155 ns 17801099 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/SimpleChains/(64, 64, 1, 128) 1167020 ns 1167072.5 ns 1.00
Conv((3, 3), 1 => 1)/cpu/reverse/Enzyme/(64, 64, 1, 128) 5846719 ns 2522587.5 ns 2.32
Conv((3, 3), 1 => 1)/cpu/forward/NamedTuple/(64, 64, 1, 128) 2045007 ns 2058692 ns 0.99
Conv((3, 3), 1 => 1)/cpu/forward/ComponentArray/(64, 64, 1, 128) 2022337 ns 2036180 ns 0.99
Conv((3, 3), 1 => 1)/cpu/forward/Flux/(64, 64, 1, 128) 2063603 ns 2076926 ns 0.99
Conv((3, 3), 1 => 1)/cpu/forward/SimpleChains/(64, 64, 1, 128) 196813.5 ns 199031.5 ns 0.99
Dense(200 => 200)/cpu/reverse/ReverseDiff (compiled)/(200, 128) 291275 ns 293498 ns 0.99
Dense(200 => 200)/cpu/reverse/Zygote/(200, 128) 267982 ns 268221 ns 1.00
Dense(200 => 200)/cpu/reverse/Tracker/(200, 128) 367838.5 ns 371053 ns 0.99
Dense(200 => 200)/cpu/reverse/ReverseDiff/(200, 128) 412217 ns 410737 ns 1.00
Dense(200 => 200)/cpu/reverse/Flux/(200, 128) 275110 ns 276646 ns 0.99
Dense(200 => 200)/cpu/reverse/SimpleChains/(200, 128) 409857 ns 408282 ns 1.00
Dense(200 => 200)/cpu/reverse/Enzyme/(200, 128) 83636 ns 83415 ns 1.00
Dense(200 => 200)/cpu/forward/NamedTuple/(200, 128) 83320.5 ns 82334 ns 1.01
Dense(200 => 200)/cpu/forward/ComponentArray/(200, 128) 82594 ns 81883 ns 1.01
Dense(200 => 200)/cpu/forward/Flux/(200, 128) 86802 ns 86902 ns 1.00
Dense(200 => 200)/cpu/forward/SimpleChains/(200, 128) 104545 ns 104605 ns 1.00
Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff (compiled)/(64, 64, 16, 128) 185167203.5 ns 194623522 ns 0.95
Conv((3, 3), 16 => 16)/cpu/reverse/Zygote/(64, 64, 16, 128) 324992428.5 ns 325666215 ns 1.00
Conv((3, 3), 16 => 16)/cpu/reverse/Tracker/(64, 64, 16, 128) 396720338.5 ns 376316433 ns 1.05
Conv((3, 3), 16 => 16)/cpu/reverse/ReverseDiff/(64, 64, 16, 128) 445233465 ns 460801847 ns 0.97
Conv((3, 3), 16 => 16)/cpu/reverse/Flux/(64, 64, 16, 128) 353083476 ns 370538766.5 ns 0.95
Conv((3, 3), 16 => 16)/cpu/reverse/SimpleChains/(64, 64, 16, 128) 319499707 ns 331521847.5 ns 0.96
Conv((3, 3), 16 => 16)/cpu/reverse/Enzyme/(64, 64, 16, 128) 101367299 ns 51302675 ns 1.98
Conv((3, 3), 16 => 16)/cpu/forward/NamedTuple/(64, 64, 16, 128) 43444745 ns 43908949 ns 0.99
Conv((3, 3), 16 => 16)/cpu/forward/ComponentArray/(64, 64, 16, 128) 43149658.5 ns 43659143 ns 0.99
Conv((3, 3), 16 => 16)/cpu/forward/Flux/(64, 64, 16, 128) 57280073 ns 49882967 ns 1.15
Conv((3, 3), 16 => 16)/cpu/forward/SimpleChains/(64, 64, 16, 128) 28586608.5 ns 28606771 ns 1.00
Dense(2000 => 2000)/cpu/reverse/ReverseDiff (compiled)/(2000, 128) 19812828 ns 19008651 ns 1.04
Dense(2000 => 2000)/cpu/reverse/Zygote/(2000, 128) 19432354 ns 19547286 ns 0.99
Dense(2000 => 2000)/cpu/reverse/Tracker/(2000, 128) 23151289 ns 23503093.5 ns 0.99
Dense(2000 => 2000)/cpu/reverse/ReverseDiff/(2000, 128) 24026798 ns 24136239 ns 1.00
Dense(2000 => 2000)/cpu/reverse/Flux/(2000, 128) 19546815.5 ns 19602327 ns 1.00
Dense(2000 => 2000)/cpu/reverse/Enzyme/(2000, 128) 6512247 ns 6527660 ns 1.00
Dense(2000 => 2000)/cpu/forward/NamedTuple/(2000, 128) 6512990 ns 6545469 ns 1.00
Dense(2000 => 2000)/cpu/forward/ComponentArray/(2000, 128) 6526621 ns 6479821 ns 1.01
Dense(2000 => 2000)/cpu/forward/Flux/(2000, 128) 6518545 ns 6502955 ns 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.