fix beam search transformers test, failing with KeyError: 'limit_hpu_graphs'#448
fix beam search transformers test, failing with KeyError: 'limit_hpu_graphs'#448kalyanjk wants to merge 1 commit into
Conversation
|
please review @dvarshney-habana and @regisss |
|
@kalyanjk : Did you try executing the test with the steps mentioned in the issue, if so can you paste the results here ? |
|
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. |
There was a problem hiding this comment.
@kalyanjk limit_hpu_graphs should already be in the generation config of the model and thus in the model_kwargs. I think it's rather an issue of adapt_transformers_to_gaudi not being called in https://github.com/huggingface/optimum-habana/blob/main/tests/transformers/tests/generation/test_utils.py.
|
This can be closed. Issue fixed via : #482 |
Co-authored-by: Iman Gohari <s.m.iman.gohari@intel.com>

What does this PR do?
Fixes #445
Before submitting