Skip to content

add ENABLE_CONST_MARKING flag in OH#101

Merged
MrGeva merged 1 commit into
habana-mainfrom
yant
Mar 12, 2024
Merged

add ENABLE_CONST_MARKING flag in OH#101
MrGeva merged 1 commit into
habana-mainfrom
yant

Conversation

@Yantom1
Copy link
Copy Markdown

@Yantom1 Yantom1 commented Mar 12, 2024

This is a WA for memory issue we are having when running 1x with const marking, so meanwhile we disable it.

@MrGeva MrGeva merged commit 93eeebd into habana-main Mar 12, 2024
@astachowiczhabana
Copy link
Copy Markdown

huggingface#831

astachowiczhabana added a commit that referenced this pull request Jan 19, 2025
* to support qdq do generation

Signed-off-by: changwangss <changwang@habana.ai>

* [SW-212057] Enable QDQ

Change-Id: I02cb066bd7e40a89c73118aff1b985568560137d

* Changed scale format to scalar, added support

Change-Id: I4fe8812c065b661cdb1c6c8d7a36cc3e2752998b

* Update modeling_llama.py - revert scalar type comment

---------

Signed-off-by: changwangss <changwang@habana.ai>
Co-authored-by: changwangss <changwang@habana.ai>
Co-authored-by: Adam Stachowicz <105052242+astachowiczhabana@users.noreply.github.com>
HolyFalafel added a commit that referenced this pull request Jan 19, 2025
xinyu-intel pushed a commit that referenced this pull request Mar 4, 2025
* to support qdq do generation

Signed-off-by: changwangss <changwang@habana.ai>

* [SW-212057] Enable QDQ

Change-Id: I02cb066bd7e40a89c73118aff1b985568560137d

* Changed scale format to scalar, added support

Change-Id: I4fe8812c065b661cdb1c6c8d7a36cc3e2752998b

* Update modeling_llama.py - revert scalar type comment

---------

Signed-off-by: changwangss <changwang@habana.ai>
Co-authored-by: changwangss <changwang@habana.ai>
Co-authored-by: Adam Stachowicz <105052242+astachowiczhabana@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants