Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Commit

Permalink
Update row_sparse tutorial (#13414)
Browse files Browse the repository at this point in the history
Update row_sparse tutorial
  • Loading branch information
eric-haibin-lin authored Nov 30, 2018
1 parent 55acf56 commit dabd688
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/tutorials/sparse/row_sparse.md
Original file line number Diff line number Diff line change
Expand Up @@ -459,7 +459,7 @@ Note that warning messages will be printed when such a storage fallback event ha

## Sparse Optimizers

In MXNet, sparse gradient updates are applied when weight, state and gradient are all in `row_sparse` storage.
In MXNet, sparse gradient updates are applied when gradient is in `row_sparse` storage and the optimizer is created with `lazy_update=True`.
The sparse optimizers only update the row slices of the weight and the states whose indices appear
in `gradient.indices`. For example, the default update rule for SGD optimizer is:

Expand Down

0 comments on commit dabd688

Please sign in to comment.