Skip to content

fix data-type mismatch for mlperf_inference accuracy test#296

Merged
1 commit merged into
HabanaAI:habana-mainfrom
kalyanjk:acc_test
Jul 15, 2024
Merged

fix data-type mismatch for mlperf_inference accuracy test#296
1 commit merged into
HabanaAI:habana-mainfrom
kalyanjk:acc_test

Conversation

@kalyanjk
Copy link
Copy Markdown

fix data-type mismatch for mlperf_inference accuracy test

@ghost ghost merged commit 5920112 into HabanaAI:habana-main Jul 15, 2024
kalyanjk added a commit to kalyanjk/optimum-habana-fork that referenced this pull request Jul 15, 2024
ghost pushed a commit that referenced this pull request Jul 15, 2024
kalyanjk added a commit to kalyanjk/optimum-habana-fork that referenced this pull request Jul 19, 2024
@astachowiczhabana
Copy link
Copy Markdown

huggingface#1146

xinyu-intel pushed a commit that referenced this pull request Mar 4, 2025
Change-Id: I4cfa730d42b0d1b38465386a8a921034e1f03dc0
Co-authored-by: Kalyan <kkumar@habana.ai>
astachowiczhabana added a commit that referenced this pull request May 26, 2025
…x7B (torch.compile) (v2) (#297)

* [SW-224449] Add an option to specialize on float inputs for Mixtral 8x7B (torch.compile) (#286)

* Add option to specialize_float in torch_dynamo for text-generation

* update README for --dynamo_specialize_float

* Update examples/text-generation/README.md

Co-authored-by: Yaser Afshar <yaser.afshar@intel.com>

* Update examples/text-generation/run_generation.py

Co-authored-by: Yaser Afshar <yaser.afshar@intel.com>

---------

Co-authored-by: Yaser Afshar <yaser.afshar@intel.com>
Co-authored-by: Adam Stachowicz <105052242+astachowiczhabana@users.noreply.github.com>

* Revert "[SW-224449] Add an option to specialize on float inputs for Mixtral 8…" (#296)

This reverts commit 88579fb1ca3a369793e3713576b155e85a39d0a6.

* Add an option to specialize on float inputs for Mixtral 8x7B (torch.compile) v2

---------

Co-authored-by: Yaser Afshar <yaser.afshar@intel.com>
Co-authored-by: Adam Stachowicz <105052242+astachowiczhabana@users.noreply.github.com>
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants