v0.4.20

Lux v0.4.20

Diff since v0.4.19

Merged pull requests:

• Allow fmapping over the model (#144) (@avik-pal)

v0.4.19

Lux v0.4.19

Diff since v0.4.18

Closed issues:

• Named Layers for Container Types (#79)
• CUDNNError during backpropagation in simple CNN (#141)

Merged pull requests:

• Named Layers inside Generic Containers (#143) (@avik-pal)

v0.4.18

Lux v0.4.18

Diff since v0.4.17

Closed issues:

• checkpointing for backpropagation (#139)

Merged pull requests:

• Remove Val in typeinfo of WeightNorm (#140) (@avik-pal)

v0.4.17

Lux v0.4.17

Diff since v0.4.16

Closed issues:

• Inconsistent descripition of PairwiseFusion (#130)
• No method matching with argument IRTools.Inner.Undefined in gradient computation. (#134)

Merged pull requests:

• LSTM docs: don't go over first element in sequence twice (#132) (@visr)
• fix PairwiseFusion docs (#133) (@MilkshakeForReal)
• Generic recurrent cells (#136) (@jumerckx)
• relu tests with finite diff is too unreliable (#137) (@avik-pal)

v0.4.16

Lux v0.4.16

Diff since v0.4.15

Merged pull requests:

• Trainable hidden states (#117) (@lungd)

v0.4.15

Lux v0.4.15

Diff since v0.4.14

Merged pull requests:

• Relax ComponentArrays compat (#126) (@avik-pal)

v0.4.14

Lux v0.4.14

Diff since v0.4.13

Merged pull requests:

• Rnn bias deprecation (#120) (@lungd)
• Add use_bias kwarg to LSTMCell and GRUCell (#121) (@lungd)

v0.4.13

Lux v0.4.13

Diff since v0.4.12

Closed issues:

• Make it easier to pass empty state st = (;) (#118)
• is there transposed convolution (#122)
• Support for multidimensional data? (#123)

Merged pull requests:

• Fix Scale's paramlength (#116) (@lungd)
• Update docs for dense layer (#124) (@avik-pal)
• Upper bound ComponentArrays (#125) (@avik-pal)
• Layer Normalization Implementation (#127) (@avik-pal)

v0.4.12

Lux v0.4.12

Diff since v0.4.11

Closed issues:

• optimising parameters with Optimization.jl (#108)
• add OrdinaryDiffEq downstream test (#110)

Merged pull requests:

• fix state update in NeuralODE example (#107) (@gabrevaya)
• Deprecate elementwise_* and applyactivation (#113) (@avik-pal)
• Go through the dense bias deprecation (#114) (@avik-pal)

v0.4.11

Lux v0.4.11

Diff since v0.4.10

Closed issues:

• WeightNorm causes NaN for Conv layer gradients (#95)

Merged pull requests:

• [LuxTraining] Wrappers for less clunky training loops (#104) (@avik-pal)
• Fixes WeightNorm with zero Parameter bug (#106) (@avik-pal)