Skip to content

Fix for view+inplace error from Falcon #127

Merged
vivekgoe merged 11 commits into
habana-mainfrom
schoi/falcon_180b_quant_PR
Mar 21, 2024
Merged

Fix for view+inplace error from Falcon #127
vivekgoe merged 11 commits into
habana-mainfrom
schoi/falcon_180b_quant_PR

Conversation

@schoi-habana
Copy link
Copy Markdown

This PR fixes the below error from run_lm_eval.py

RuntimeError: Output 0 of torch::autograd::CppNode is a view and is being modified inplace. This view was created inside a custom Function (or because an input was returned as-is) and the autograd logic to
handle view+inplace would override the custom backward associated with the custom Function, leading to incorrect gradients. This behavior is forbidden. You can fix this by cloning the output of the custom Function.

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you make sure to update the documentation with your changes?
  • Did you write any new necessary tests?

@schoi-habana schoi-habana requested a review from a user March 21, 2024 00:19
@hchauhan123 hchauhan123 requested a review from MrGeva March 21, 2024 01:33
@vivekgoe vivekgoe merged commit de9a56b into habana-main Mar 21, 2024
@astachowiczhabana
Copy link
Copy Markdown

huggingface#831

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants