Skip to content

Add mark_step only for inference#126

Merged
1 commit merged into
HabanaAI:habana-mainfrom
kalyanjk:main_mark_step
Mar 21, 2024
Merged

Add mark_step only for inference#126
1 commit merged into
HabanaAI:habana-mainfrom
kalyanjk:main_mark_step

Conversation

@kalyanjk
Copy link
Copy Markdown

Add mark_step only for inference to split the graphs so that it fits in memory

@kalyanjk kalyanjk requested a review from a user March 20, 2024 16:51
@ghost ghost merged commit a01d175 into HabanaAI:habana-main Mar 21, 2024
astachowiczhabana pushed a commit that referenced this pull request Apr 5, 2024
Co-authored-by: Kalyan <kkumar@habana.ai>
astachowiczhabana pushed a commit that referenced this pull request Apr 5, 2024
Co-authored-by: Kalyan <kkumar@habana.ai>
astachowiczhabana pushed a commit that referenced this pull request Apr 19, 2024
Co-authored-by: Kalyan <kkumar@habana.ai>
astachowiczhabana pushed a commit that referenced this pull request Apr 22, 2024
Co-authored-by: Kalyan <kkumar@habana.ai>
astachowiczhabana pushed a commit that referenced this pull request Apr 24, 2024
Co-authored-by: Kalyan <kkumar@habana.ai>
astachowiczhabana pushed a commit that referenced this pull request Apr 24, 2024
Co-authored-by: Kalyan <kkumar@habana.ai>
@astachowiczhabana
Copy link
Copy Markdown

astachowiczhabana commented Jun 12, 2024

huggingface#875

@kalyanjk kalyanjk deleted the main_mark_step branch July 5, 2024 11:47
astachowiczhabana pushed a commit that referenced this pull request Jan 29, 2025
* [SW-190418] Updated lm eval harness version to 0.4.2

 * Adapted code to changes of API
     replaced BaseLM with HFLM
  ** Replaced evaluator.evaluate call with evaluator.simple_evaluate
 * Added typehints
 * updated requirements

* Added useful argument to lm-eval to prevent printing all of the samples tested by default

---------

Co-authored-by: Daniel Ohayon <dohayon@habana.ai>
xinyu-intel pushed a commit that referenced this pull request Mar 4, 2025
* [SW-190418] Updated lm eval harness version to 0.4.2

 * Adapted code to changes of API
     replaced BaseLM with HFLM
  ** Replaced evaluator.evaluate call with evaluator.simple_evaluate
 * Added typehints
 * updated requirements

* Added useful argument to lm-eval to prevent printing all of the samples tested by default

---------

Co-authored-by: Daniel Ohayon <dohayon@habana.ai>
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants