Skip to content

Can gradients be tracked in both Module::forward() and Module::forward_mut()? YES

Corey Lowman edited this page Aug 20, 2022 · 1 revision

These two methods actually have nothing to do with tracking gradients. They only affect whether the module's can be updated. Both versions support tracking gradients, however some modules may have different behaviors in both.