-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix truncated_bptt_steps hiddens detach() and improve docs #8145
Conversation
Signed-off-by: Guillaume Tauzin <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
Could I get any suggestions wrt where I should add my test? |
for more information, see https://pre-commit.ci
Codecov Report
@@ Coverage Diff @@
## master #8145 +/- ##
=======================================
- Coverage 93% 88% -5%
=======================================
Files 212 212
Lines 13679 13693 +14
=======================================
- Hits 12720 12050 -670
- Misses 959 1643 +684 |
Signed-off-by: Guillaume Tauzin <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
great improvement!
…ning into truncated_bptt_fix
Signed-off-by: Guillaume Tauzin <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
Hello @gtauzin! Thanks for updating this PR. There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻 Comment last updated at 2021-07-01 16:28:20 UTC |
Signed-off-by: Guillaume Tauzin <[email protected]>
for more information, see https://pre-commit.ci
Signed-off-by: Guillaume Tauzin <[email protected]>
…ning into truncated_bptt_fix
I believe it is ready. Not that I could not run the test locally on my laptop. The |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @gtauzin <3
You're welcome @awaelchli. Any idea when the release including this change will be out? |
@gtauzin since this is a bugfix, it will go into next week's patch release and/or RC release, given that it is merged until then :) |
Co-authored-by: Carlos Mocholí <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
Signed-off-by: Guillaume Tauzin <[email protected]>
What does this PR do?
This PR was discussed on Slack with @awaelchli.
It fixes the detach() on hiddens in the case it is a tuple of Tensors (typically, for nn.LSTM).
It reverts the documentation change that I pushed on #7846 as it turned out to be incorrect.
It also proposes a documentation improvement explaining a bit more what (I understood) happens behind the scenes and stresses the importance of using it along with
batch_first=True
. Please let me know if this is correct!Before submitting
PR review
Anyone in the community is free to review the PR once the tests have passed.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:
Did you have fun?
Make sure you had fun coding 🙃