Skip to content

Commit

Permalink
Update "Composing Optimisers" docs
Browse files Browse the repository at this point in the history
Use `1` instead of `0.001` for first argument of `ExpDecay` in example.
  • Loading branch information
StevenWhitaker authored Jun 24, 2021
1 parent de76e08 commit 6235c2a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/src/training/optimisers.md
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ Flux defines a special kind of optimiser simply called `Optimiser` which takes i
that will be fed into the next, and the resultant update will be applied to the parameter as usual. A classic use case is where adding decays is desirable. Flux defines some basic decays including `ExpDecay`, `InvDecay` etc.

```julia
opt = Optimiser(ExpDecay(0.001, 0.1, 1000, 1e-4), Descent())
opt = Optimiser(ExpDecay(1, 0.1, 1000, 1e-4), Descent())
```

Here we apply exponential decay to the `Descent` optimiser. The defaults of `ExpDecay` say that its learning rate will be decayed every 1000 steps.
Expand Down

0 comments on commit 6235c2a

Please sign in to comment.