Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Better CUDNN Dispatches #16

Merged
merged 6 commits into from
May 11, 2022
Merged

Better CUDNN Dispatches #16

merged 6 commits into from
May 11, 2022

Conversation

avik-pal
Copy link
Member

@avik-pal avik-pal commented May 8, 2022

  • Broadcasted Operations are often faster using cudnnOpTensor instead of the default .<op>
  • We don't store boolean in state anymore. Using Val we can compile away most train vs test branching

@codecov
Copy link

codecov bot commented May 8, 2022

Codecov Report

Merging #16 (a737ef5) into main (3e6a6d7) will increase coverage by 0.36%.
The diff coverage is 38.46%.

@@            Coverage Diff             @@
##             main      #16      +/-   ##
==========================================
+ Coverage   30.07%   30.44%   +0.36%     
==========================================
  Files          12       12              
  Lines         778      808      +30     
==========================================
+ Hits          234      246      +12     
- Misses        544      562      +18     
Impacted Files Coverage Δ
src/Lux.jl 100.00% <ø> (ø)
src/transform.jl 79.31% <ø> (ø)
src/autodiff.jl 13.33% <8.33%> (+0.83%) ⬆️
src/nnlib.jl 38.83% <35.95%> (-9.61%) ⬇️
src/layers/basic.jl 41.37% <36.00%> (+0.23%) ⬆️
src/layers/normalize.jl 16.03% <36.66%> (-2.15%) ⬇️
src/layers/dropout.jl 37.03% <40.00%> (+4.77%) ⬆️
src/utils.jl 36.23% <61.53%> (+5.19%) ⬆️
src/layers/conv.jl 31.00% <85.71%> (ø)
src/core.jl 52.77% <100.00%> (ø)
... and 3 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 3e6a6d7...a737ef5. Read the comment docs.

@avik-pal avik-pal changed the title [WIP] Better CUDNN Dispatches Better CUDNN Dispatches May 11, 2022
@avik-pal avik-pal merged commit 4c512ce into main May 11, 2022
@avik-pal avik-pal deleted the ap/norm branch May 11, 2022 18:59
avik-pal added a commit that referenced this pull request Nov 3, 2024
avik-pal added a commit that referenced this pull request Nov 3, 2024
avik-pal added a commit that referenced this pull request Nov 3, 2024
…ns/create-pull-request-6

Bump peter-evans/create-pull-request from 5 to 6
avik-pal added a commit that referenced this pull request Nov 3, 2024
Fix CA in FiniteDifferences
avik-pal added a commit that referenced this pull request Nov 3, 2024
…ions/setup-julia-2

Bump julia-actions/setup-julia from 1 to 2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant