Skip to content

Add nograd() to prevent backward backend#897

Merged
regisss merged 1 commit into
huggingface:mainfrom
HabanaAI:llama_compile_backend_in_eval
Apr 26, 2024
Merged

Add nograd() to prevent backward backend#897
regisss merged 1 commit into
huggingface:mainfrom
HabanaAI:llama_compile_backend_in_eval

Conversation

@astachowiczhabana

@astachowiczhabana astachowiczhabana commented Apr 17, 2024

Copy link
Copy Markdown
Collaborator

examples/text-generation/run_lm_eval.py didn't work with torch.compile mode. Adding nograd() to HabanaModelAdapter prevents backward backend.

@libinta libinta added the run-test Run CI for PRs from external contributors label Apr 23, 2024
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@regisss regisss merged commit e1f98e1 into huggingface:main Apr 26, 2024
ccrhx4 pushed a commit to ccrhx4/ccrhx4.optimum-habana that referenced this pull request May 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-test Run CI for PRs from external contributors

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants