Skip to content

Commit

Permalink
Update row_sparse tutorial (apache#13414)
Browse files Browse the repository at this point in the history
Update row_sparse tutorial
  • Loading branch information
eric-haibin-lin authored and zhaoyao73 committed Dec 9, 2018
1 parent 42d16ae commit 1aa09bc
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/tutorials/sparse/row_sparse.md
Original file line number Diff line number Diff line change
Expand Up @@ -459,7 +459,7 @@ Note that warning messages will be printed when such a storage fallback event ha

## Sparse Optimizers

In MXNet, sparse gradient updates are applied when weight, state and gradient are all in `row_sparse` storage.
In MXNet, sparse gradient updates are applied when gradient is in `row_sparse` storage and the optimizer is created with `lazy_update=True`.
The sparse optimizers only update the row slices of the weight and the states whose indices appear
in `gradient.indices`. For example, the default update rule for SGD optimizer is:

Expand Down

0 comments on commit 1aa09bc

Please sign in to comment.