Skip to content

Commit

Permalink
Merge pull request #150 from Amir-Arsalan/patch-1
Browse files Browse the repository at this point in the history
Update algos.md
  • Loading branch information
soumith authored Feb 8, 2017
2 parents 89ef52a + 19c8283 commit 656c42a
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions doc/algos.md
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,8 @@ Arguments:
* `x`: the initial point
* `config`: a table with configuration parameters for the optimizer
* `config.learningRate`: learning rate
* `config.learningRateDecay`: learning rate decay
* `config.weightDecay`: weight decay coefficient for regularization
* `state`: a table describing the state of the optimizer; after each call the state is modified
* `state.paramVariance`: vector of temporal variances of parameters

Expand All @@ -201,6 +203,7 @@ Arguments:
* `config`: a table with configuration parameters for the optimizer
* `config.learningRate`: learning rate
* `config.learningRateDecay`: learning rate decay
* `config.weightDecay`: weight decay coefficient for regularization
* `config.beta1`: first moment coefficient
* `config.beta2`: second moment coefficient
* `config.epsilon`: for numerical stability
Expand Down

0 comments on commit 656c42a

Please sign in to comment.