v0.12.9

Flux v0.12.9

Diff since v0.12.8

Closed issues:

• Coverage (#89)
• Support for grouped convolutions (#330)
• onehot.md in docs should not have subtitle "Batches" (#510)
• Repo tagged with the "the-human-brian" (potential typo) (#512)
• RNNs, batching and sequences (#705)
• Model Zoo Housing.jl Example functionality not clear (#769)
• Asymmetric padding fails on gpu models (#775)
• Can't get user defined model to work (#812)
• Cryptic error in Flux#zygote "Can't differentiate foreigncall expression" (#817)
• Passing transposed matrix to softmax causes scalar indexing on GPU, which is very slow (#888)
• Does it support training on multiple GPUs? (#910)
• batched_mul causes a 'cannot take the CPU address of a CuArray' error on GPU (#1090)
• CTC loss (#1135)
• Inconsistent behavior of gradient of empty matrices (#1151)
• Flux.Conv type instability (#1178)
• CUDA.jl (#1194)
• Incorrect types following CUDA.jl refactoring (#1200)
• Got an error, while trying to implement softplus with beta (#1216)
• test regression with recurrent neural networks (#1245)
• regression in RNN with OneHotMatrix and CUDA (#1262)
• Gradient calculation bug re-introduced in Flux v0.10.4 and Zygote v0.4.22 (#1269)
• LSTM "succeeds" on data with incompatible dimensions (#1396)
• Document conv data handling, especially for 1d (#1465)
• Flux.destructure gives DimensionMismatch error in backward pass due to Chain of mutable struct(s) (#1502)
• Adjoints for regularizers? (#1575)
• Zygote error: UndefVarError: S not defined (#1578)
• Warning using Flux on Linux device without CUDA or Nvidia card (#1581)
• Flux downloads CUDA110 Artifacts every time I precompile on Ubuntu (#1600)
• Why does calling the gpu function not return an error when CUDA is unavailable (#1634)
• Flux errors on Julia 1.7 Beta 2 (#1652)
• LLVM 4.x.x compatibility (#1669)
• Add better docs for the LSTM function (#1696)
• Recurrent docs out of sync (#1714)
• Docs haven't built since Aug. 3 (#1723)
• Investigate nightly CI build issues (#1724)
• unsqueeze is not type stable (#1737)
• failing doc tests (#1739)
• Link to "train!" gives 404 page not found error on the website. (#1745)
• Issues model with custom gradient (w.r.t. input variable) layer (#1760)
• Flux.loadparams! is slow. (#1764)
• world age issues when loading a bson file containing a model with flux utility functions (#1769)
• How to fast find source code of function, like Dense() Chain() (#1770)
• How to get the mathematical expression of Neural Network. (#1771)
• How to write a seq of w_i: w_1, w_2, ... , w_1000 (#1773)
• Error when training simple Flux model (#1777)
• Differentiating through my custom struct its restructuring throws an error (#1796)
• Incompatibility with SpecialFunctions 2.0 (#1802)
• Buildkite CI failures with grad test of ConvTranspose + selu (#1804)
• Slowdown when running multiple large models in parallel (#1806)
• ERROR: LoadError: Some tests did not pass: 252 passed, 1 failed, 0 errored, 21 broken. in expression starting at /home/ian/.julia/packages/Flux/BPPNj/test/runtests.jl:11 ERROR: Package Flux errored during testing (#1814)
• Can ExpDecay of learning rate start at some intermediate step? (#1815)
• Optimisers epsilon (#1818)
• Zygote Flux and custom adjoints on GPU (#1828)
• TypeErro in DEQ example: non-boolean (Nothing) used in boolean context #677 (#1846)

Merged pull requests:

• Clarify that params updates (#1752) (@KronosTheLate)
• Add custom model example to docs. (#1758) (@Gregliest)
• Make unsqueeze type stable (#1759) (@cossio)
• Use view for RNN gate slice extraction (#1761) (@ToucheSir)
• Doc update (saving.md): removed outdated info; Typo fix. (#1762) (@NightMachinary)
• Doc update (recurrence.md): fixed incorrect output dimensions, clarified batching. (#1763) (@NightMachinary)
• Expand RNN/LSTM/GRU docs (#1772) (@mcognetta)
• Fix a doctest failure (#1775) (@mcognetta)
• Use conjugates in optimizers to better learn on complex-valued inputs (#1776) (@staticfloat)
• Fix AlphaDropout implementation and add tests (#1781) (@ToucheSir)
• add logo to documentation (#1782) (@kwehmeyer)
• Doc update (training.md): fix DataLoader example in Training section (#1783) (@eliascarv)
• Fix link to train in the docs (#1784) (@logankilpatrick)
• Update train.jl to add a more detailed train! docstring (#1785) (@logankilpatrick)
• Add docstring for params (#1786) (@logankilpatrick)
• Create a PR comment with docs preview link (#1788) (@logankilpatrick)
• Add trilinear Upsample layer (#1792) (@tknopp)
• Tidy up Maxout (#1794) (@mcabbott)
• Simplify mse() to use abs2() (#1795) (@staticfloat)
• Mark destructure gradient test as broken (#1797) (@ToucheSir)
• Fix failing params doctests (#1798) (@ToucheSir)
• Only add PR comment with docs build if the docs label is added (#1799) (@logankilpatrick)
• Add more context on the behavior of the GPU function (#1800) (@logankilpatrick)
• Add warning if the GPU function is called and CUDA is not available (#1801) (@logankilpatrick)
• Add buildkite step to run on Julia LTS (#1805) (@DhairyaLGandhi)
• ExpDecay start step (#1816) (@cossio)
• make eps a parameter of optimisers (#1819) (@cossio)
• Contributor's Guide draft (#1824) (@lilianabs)
• Update conv.jl (#1825) (@rkube)
• CompatHelper: bump compat for ArrayInterface to 4, (keep existing compat) (#1827) (@github-actions[bot])
• Remove "Batches" from one hot section header in docs (#1831) (@darsnack)
• Document disabling GPUs (#1835) (@DhairyaLGandhi)
• Try using latest cu(DNN) binaries (#1836) (@ToucheSir)
• Add news for bump version (#1838) (@DhairyaLGandhi)
• move eps to the end (#1840) (@cossio)
• Add codecov on CI (#1842) (@ToucheSir)
• add token secret for codecov (#1845) (@ToucheSir)
• CompatHelper: bump compat for NNlib to 0.8, NNlibCUDA to 0.2 (keep existing compat) (#1847) (@github-actions[bot])
• Tweak docs about disabling CUDA devices (#1850) (@IanButterworth)