Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
66 commits
Select commit Hold shift + click to select a range
b5a6aa0
Release 1.19 only: QA changes to examples
astachowiczhabana Jul 7, 2025
4f7b3cc
Upgrade to lm_eval==4.8.0 (#2082)
astachowiczhabana Jun 25, 2025
6f1cfce
Add support for setting --junitxml output via JUNITXML_DIR environmen…
astachowiczhabana Jul 7, 2025
67c662e
Bitsandbytes installation for qlora tests (#1951)
astachowiczhabana Jul 7, 2025
76f6bd7
Temporarily revert SD quant files to fix promotion (#2069)
astachowiczhabana Jul 7, 2025
0955a80
Update readme files for explicit lazy mode (#1921)
astachowiczhabana Jul 7, 2025
b017b2b
Integrated NF4 inference tests to text-generation (#2058)
astachowiczhabana Jul 7, 2025
54aded1
Remove bitsandbytes monkey-patching (II) (#2114)
astachowiczhabana Jul 7, 2025
c03dbea
Add groups to slow_tests_image_to_text_example (#2008)
astachowiczhabana Jul 7, 2025
61be32b
Lm eval accuracy regression fix (#2105)
astachowiczhabana Jul 7, 2025
2b66513
Skip unnecessary padding in text generation task (#2055)
astachowiczhabana Jul 7, 2025
1cf2032
Reduce index_copy to fp8 in llama2 - QDQ flow #2065
astachowiczhabana Jul 7, 2025
62b45d7
Unify SetTrueOrFalseOrNone and StoreTrueFalseAction (#2119)
astachowiczhabana Jul 9, 2025
a5500ea
Fix profiler (#2134)
astachowiczhabana Jul 11, 2025
ccf00fb
Fix missing openorca dataset (#2133)
astachowiczhabana Jul 11, 2025
ca2f994
Fix utils package #2141 (#2142)
astachowiczhabana Jul 11, 2025
5cc564e
Sync/videollava (#2129)
yafshar Jul 11, 2025
7182e21
Fix Mllama model placement (#2125)
pbielak Jul 14, 2025
4ba841d
Add boft support in stable-diffusion (#1295)
sywangyi Jul 11, 2025
1c0d4c0
Add Qwen classification (#2062)
tianyuan211 Jul 11, 2025
efc1e29
Merge branch 'main' into v1.19-release
astachowiczhabana Jul 14, 2025
f10d7d9
Synapse 1.22 Optimum Habana 1.19 (#2137)
astachowiczhabana Jul 15, 2025
75b4765
Move import to local scope in run_lm_eval, to allow prior env vars in…
AKloniecki Jul 16, 2025
c3e3adb
Pin opencv version to 4.10.0.84 and remove pinned numpy version. (#2145)
AKloniecki Jul 16, 2025
a08cef7
Add support for local dataset loading for LibriSpeech and COCO (#2136)
Jul 16, 2025
1381d7a
Enabling Snowflake Arctic on Gaudi 3 (#1719)
pi314ever Jul 16, 2025
a07fa48
Use `eval_strategy` in sentence-transformers-training (#2151)
pbielak Jul 16, 2025
4a37df6
Add `sentencepiece` to setup.py (#2153)
pbielak Jul 17, 2025
77a0f37
Diffusers 0.34.0 (#2152)
Jul 17, 2025
9e79289
Use profiler in text-generation-pipeline (#2154)
pbielak Jul 17, 2025
6d2770e
Merge branch 'main' into v1.19-release
astachowiczhabana Jul 18, 2025
4161cbe
Lm eval fix for datasets based on a loading script (#2144)
12010486 Jul 18, 2025
5da85a9
[SW-234584] Bump protobuf version (#2155)
astachowiczhabana Jul 18, 2025
5110bf9
Pin datasets to version 3.6.0 to preserve trust_remote_code compatibi…
Jul 22, 2025
ae34d2a
Fix requirements in text-classification (#2158)
pbielak Jul 22, 2025
4336b2f
Factor out model_initialization from pipeline constructor, and pass i…
AKloniecki Jul 21, 2025
92fb153
Update datasets to `3.6.0` in text-to-speech and translation (#2166)
pbielak Jul 22, 2025
9929a14
fea(trl): updated peft version (#2160)
Jul 21, 2025
1d65ac4
Remove 'is_pt_flax_cross_test` from `wav2vec` tests (#2174)
pbielak Jul 28, 2025
48a2dae
Fix `test_model_weights_reload_no_missing_tied_weights` (#2175)
pbielak Jul 28, 2025
67c8576
Add the PT_HPU_LAZY_MODE=1 env variable when testing in lazy mode (#2…
yafshar Jul 21, 2025
40caf59
Fix version extraction regex and pip command in get_build() (#2159)
yafshar Jul 21, 2025
e3c35ea
Pin `datasets==3.6.0` for question answering examples (#2182)
pbielak Jul 30, 2025
077c272
Move torch, transformers and optimum.habana imports to local scope. (…
AKloniecki Jul 30, 2025
f8caf40
Extract model adapter class from run_lm_eval.py to a new script file.…
AKloniecki Jul 31, 2025
64c1e09
Move torch and transformers imports to local scope in run_generation.…
AKloniecki Jul 30, 2025
ac644aa
Add warn0 utility to emit warnings only on main process (#2157)
yafshar Jul 22, 2025
6a0ae1c
Remove DEEPSPEED_HPU_ZERO3_SYNC_MARK_STEP_REQUIRED (#2171)
yafshar Jul 28, 2025
0cb9a2a
Add Gaudi3 baselines for Qwen3
regisss Jul 28, 2025
9bf9fd3
fea(timm): Updated/Fixed the readme (#2172)
Jul 30, 2025
283005f
Enable trl GRPO trainer (#2088)
schoi-habana Jul 28, 2025
8b0c0cc
Merge branch 'main' into v1.19-release
astachowiczhabana Jul 31, 2025
2b2e336
Fix for granite accuracy (#2187)
12010486 Aug 2, 2025
2f1f441
transformer deepseek-v3 Porting to optimum-habana (#2186)
rkumar2patel Aug 2, 2025
190770f
Remove `.float()` conversion from Mixtral (#2178)
pbielak Aug 4, 2025
fd2e44c
Merge branch 'main' into v1.19-release
astachowiczhabana Aug 5, 2025
511f633
Adding more relevant args to lm_eval
12010486 Aug 6, 2025
dc88d4e
Partial support of metadata
12010486 Aug 6, 2025
888d827
Add: adding appy_chat_template config
sungwook-son Aug 7, 2025
0cee5df
[Add] apply_chat_template CLI option
12010486 Aug 7, 2025
acccc5f
Support latest lm_eval + samples and metadata args fully
12010486 Aug 7, 2025
433f568
Add system_instruction
12010486 Aug 7, 2025
bfc5e85
Add gen_kwargs
12010486 Aug 7, 2025
63ef628
Add HabanaModelAdapter attributes + _model_generate() improv
12010486 Aug 7, 2025
c9a4e74
Fix for negative max_gen_toks (e.g. in gsm8k)
12010486 Aug 8, 2025
80a3733
Added to run HumanEval
12010486 Aug 8, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/fast_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ jobs:
group: itac-bm-emr-gaudi3-dell-2gaudi

container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -43,7 +43,7 @@ jobs:
group: itac-bm-emr-gaudi3-dell-1gaudi

container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand Down
36 changes: 18 additions & 18 deletions .github/workflows/slow_tests_gaudi2.yml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -30,7 +30,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash tests/ci/example_diff_tests.sh
stable-diffusion:
name: Test Stable Diffusion
Expand All @@ -43,7 +43,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -59,7 +59,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash tests/ci/slow_tests_diffusers.sh ${{ secrets.TEXT_GENERATION_CI_HUB_TOKEN }}
deepspeed:
name: Test DeepSpeed models
Expand All @@ -72,7 +72,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -88,7 +88,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash tests/ci/slow_tests_deepspeed.sh ${{ secrets.TEXT_GENERATION_CI_HUB_TOKEN }}
fsdp:
name: Test FSDP models
Expand All @@ -101,7 +101,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -117,7 +117,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
make slow_tests_fsdp TOKEN=${{ secrets.TEXT_GENERATION_CI_HUB_TOKEN }}
multi-card:
name: Test multi-card models
Expand All @@ -130,7 +130,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -146,7 +146,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash tests/ci/slow_tests_8x.sh ${{ secrets.TEXT_GENERATION_CI_HUB_TOKEN }}
single-card:
name: Test single-card models
Expand All @@ -160,7 +160,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -177,7 +177,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash tests/ci/slow_tests_1x.sh
text-generation:
name: Test text-generation example
Expand All @@ -192,7 +192,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -208,7 +208,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
make slow_tests_text_generation_example TOKEN=${{ secrets.TEXT_GENERATION_CI_HUB_TOKEN }}
trl:
name: Test TRL integration
Expand All @@ -221,7 +221,7 @@ jobs:
uses: actions/checkout@v2
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -237,7 +237,7 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash tests/ci/slow_tests_trl.sh
sentence-transformers:
name: Test Sentence Transformers integration
Expand All @@ -258,7 +258,7 @@ jobs:
path: sentence-transformers
- name: Pull image
run: |
docker pull vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
docker pull vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
- name: Run tests
run: |
docker run \
Expand All @@ -274,5 +274,5 @@ jobs:
--cap-add=sys_nice \
--net=host \
--ipc=host \
vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest \
/bin/bash optimum-habana/tests/ci/sentence_transformers.sh
18 changes: 9 additions & 9 deletions .github/workflows/slow_tests_gaudi3.yml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-1gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -37,7 +37,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-8gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -60,7 +60,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-8gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -83,7 +83,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-8gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -106,7 +106,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-8gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -130,7 +130,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-1gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -155,7 +155,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-8gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -178,7 +178,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-1gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand All @@ -201,7 +201,7 @@ jobs:
runs-on:
group: itac-bm-emr-gaudi3-dell-1gaudi
container:
image: docker://vault.habana.ai/gaudi-docker/1.21.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
image: docker://vault.habana.ai/gaudi-docker/1.22.0/ubuntu22.04/habanalabs/pytorch-installer-2.6.0:latest
options: --workdir=/root/workspace --runtime=habana --shm-size=64G --env HABANA_VISIBLE_DEVICES --env HABANA_VISIBLE_MODULES
env:
OMPI_MCA_btl_vader_single_copy_mechanism: none
Expand Down
27 changes: 14 additions & 13 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ REAL_CLONE_URL = $(if $(CLONE_URL),$(CLONE_URL),$(DEFAULT_CLONE_URL))
export PT_HPU_LAZY_MODE=1
# will be removed when lazy is disabled

.PHONY: style test
.PHONY: style test install_deepspeed

# Run code quality checks
style_check: clean
Expand Down Expand Up @@ -96,13 +96,12 @@ slow_tests_1x: test_installs
# Run multi-card non-regression tests
slow_tests_8x: test_installs
@status1=0; status2=0; \
DATA_CACHE=$(DATA_CACHE) python -m pytest tests/test_examples.py -v -s -k "multi_card" || status1=$$?; \
DATASET_CONFIG='$(DATASET_CONFIG)' python -m pytest tests/test_examples.py -v -s -k "multi_card" || status1=$$?; \
python -m pytest tests/test_habana_profiler_integration.py -v -s -m x8 || status2=$$?; \
exit $$((status1 + status2))

# Run DeepSpeed non-regression tests
slow_tests_deepspeed: test_installs
python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.21.0
slow_tests_deepspeed: test_installs install_deepspeed
python -m pytest tests/test_examples.py -v -s -k "deepspeed"

slow_tests_diffusers: test_installs
Expand All @@ -113,10 +112,9 @@ slow_tests_sentence_transformers: test_installs
python -m pytest tests/test_sentence_transformers.py -v -s

# Run all text-generation non-regression tests
slow_tests_text_generation_example: test_installs
slow_tests_text_generation_example: test_installs install_deepspeed
python -m pip install -r examples/text-generation/requirements_awq.txt
BUILD_CUDA_EXT=0 python -m pip install -vvv --no-build-isolation git+https://github.com/HabanaAI/AutoGPTQ.git
python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.21.0
python -m pip install tiktoken blobfile
python -m pytest tests/test_text_generation_example.py tests/test_encoder_decoder.py -v -s --token $(TOKEN)

Expand All @@ -127,26 +125,26 @@ slow_tests_text_generation_example_1x: test_installs
python -m pytest tests/test_text_generation_example.py tests/test_encoder_decoder.py -m "(not x2) and (not x4) and (not x8)" -v -s --token $(TOKEN)

# Run subset of text-generation non-regression tests that require 2 Gaudi cards
slow_tests_text_generation_example_2x: test_installs
python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.21.0
slow_tests_text_generation_example_2x: test_installs install_deepspeed
python -m pytest tests/test_text_generation_example.py -m x2 -v -s --token $(TOKEN)

# Run subset of text-generation non-regression tests that require 4 Gaudi cards
slow_tests_text_generation_example_4x: test_installs
python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.21.0
slow_tests_text_generation_example_4x: test_installs install_deepspeed
python -m pytest tests/test_text_generation_example.py -m x4 -v -s --token $(TOKEN)

# Run subset of text-generation non-regression tests that require 8 Gaudi cards
slow_tests_text_generation_example_8x: test_installs
python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.21.0
slow_tests_text_generation_example_8x: test_installs install_deepspeed
python -m pytest tests/test_text_generation_example.py -m x8 -v -s --token $(TOKEN)

# Run image-to-text non-regression tests
slow_tests_image_to_text_example: test_installs
python -m pytest tests/test_image_to_text_example.py -v -s --token $(TOKEN)

slow_tests_image_to_text_example_1x: test_installs
python -m pytest tests/test_image_to_text_example.py -m "not x8" -v -s --token $(TOKEN)
python -m pytest tests/test_image_to_text_example.py -m "(not x2) and (not x8)" -v -s --token $(TOKEN)

slow_tests_image_to_text_example_2x: test_installs
python -m pytest tests/test_image_to_text_example.py -m x2 -v -s --token $(TOKEN)

slow_tests_image_to_text_example_8x: test_installs
python -m pytest tests/test_image_to_text_example.py -m x8 -v -s --token $(TOKEN)
Expand Down Expand Up @@ -225,3 +223,6 @@ clean:

test_installs:
python -m pip install .[tests]

install_deepspeed:
python -m pip install git+https://github.com/HabanaAI/DeepSpeed.git@1.21.0
9 changes: 5 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ Please refer to the Intel Gaudi AI Accelerator official [installation guide](htt
> Tests should be run in a Docker container based on Intel Gaudi's official images. Instructions to
> obtain the latest containers from the Intel Gaudi Vault are available
> [here](https://docs.habana.ai/en/latest/Installation_Guide/Additional_Installation/Docker_Installation.html#use-intel-gaudi-containers).
> The current Optimum for Intel Gaudi has been validated with Intel Gaudi v1.21 stack.
> The current Optimum for Intel Gaudi has been validated with Intel Gaudi v1.22 stack.


## Install the library and get example scripts
Expand All @@ -65,9 +65,9 @@ The `--upgrade-strategy eager` option is needed to ensure `optimum-habana` is up
To use the example associated with the latest stable release, run:
```bash
git clone https://github.com/huggingface/optimum-habana
cd optimum-habana && git checkout v1.18.0
cd optimum-habana && git checkout v1.19.0
```
with `v1.18.0` being the latest Optimum for Intel Gaudi release version.
with `v1.19.0` being the latest Optimum for Intel Gaudi release version.

### Option 2: Use the latest main branch under development

Expand Down Expand Up @@ -284,7 +284,8 @@ The following model architectures, tasks and device distributions have been vali
| ChatGLM | <li>DeepSpeed</li> | <li>Single card</li> | <li>[language modeling](https://github.com/huggingface/optimum-habana/tree/main/examples/language-modeling)</li><li>[text generation](https://github.com/huggingface/optimum-habana/tree/main/examples/text-generation)</li> |
| Qwen2-VL | | <div style="text-align:left"><li>Single card</li></div> | <li>[image to text](https://github.com/huggingface/optimum-habana/tree/main/examples/image-to-text)</li> |
| VideoLLaVA | | <div style="text-align:left"><li>Single card</li></div> | <li>[Video comprehension](https://github.com/huggingface/optimum-habana/tree/main/examples/video-comprehension)</li> |
| GLM-4V | | <div style="text-align:left"><li>Single card</li></div> | <li>[image to text](https://github.com/huggingface/optimum-habana/tree/main/examples/image-to-text)</li>
| GLM-4V | | <div style="text-align:left"><li>Single card</li></div> | <li>[image to text](https://github.com/huggingface/optimum-habana/tree/main/examples/image-to-text)</li> |
| Arctic | | <div style="text-align:left"><li>DeepSpeed</li></div> | <li>[text generation](https://github.com/huggingface/optimum-habana/tree/main/examples/text-generation)</li> |

</div>

Expand Down
Loading