Adam restricted to sparse gradient entries, see [torch.optim.SparseAdam](https://pytorch.org/docs/stable/generated/torch.optim.SparseAdam.html).
Adam restricted to sparse gradient entries, see torch.optim.SparseAdam.