Skip to content

Added hqt unify_measurement script for synapse1.15#800

Merged
regisss merged 1 commit into
huggingface:synapse_1.15from
HabanaAI:dev/dsemiat/hqt_meas_unify_script
Mar 22, 2024
Merged

Added hqt unify_measurement script for synapse1.15#800
regisss merged 1 commit into
huggingface:synapse_1.15from
HabanaAI:dev/dsemiat/hqt_meas_unify_script

Conversation

@HolyFalafel
Copy link
Copy Markdown
Contributor

A tool that takes jsons with range measurements of tensors that were measured on multiple cards and unifies this measurements so we can run quantization with less cards than we measured.

Running example:

python optimum-habana/examples/text-generation/quantization_tools/unify_measurements.py  --measurements hqt_measured_folder --groups 01234567 --out hqt_measured_unified_folder 

@HolyFalafel HolyFalafel requested a review from regisss as a code owner March 14, 2024 10:49
@libinta libinta added synapse 1.15 run-test Run CI for PRs from external contributors labels Mar 19, 2024
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@regisss regisss changed the base branch from main to synapse_1.15 March 22, 2024 22:33
@regisss regisss merged commit 6f10eb6 into huggingface:synapse_1.15 Mar 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

run-test Run CI for PRs from external contributors synapse 1.15

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants