Skip to content

[ROCM] [FEAT] Integrate Aiter hipBLASLt GEMM online tuning #40426

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
vllm-bot merged 33 commits into from
Jun 5, 2026
Merged

[ROCM] [FEAT] Integrate Aiter hipBLASLt GEMM online tuning #40426

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
a864404
Add the option to turn on hipBLASLt online tuning
hanlin12-AMD Mar 16, 2026
96cf2d1
move hip_online_tuning option into serve.py
hanlin12-AMD Mar 17, 2026
d5753b3
use environment variable instead of CLI
hanlin12-AMD Mar 17, 2026
8136fe7
Merge branch 'main' into hip_online_tuning
hanlin12-AMD Mar 17, 2026
7abf916
fixup suffix of environment variable
hanlin12-AMD Mar 17, 2026
9c8fd55
Merge branch 'main' into hip_online_tuning
hanlin12-AMD Mar 18, 2026
838438d
Merge branch 'main' into hip_online_tuning
hanlin12-AMD Mar 18, 2026
f6c46d1
Merge branch 'main' into hip_online_tuning
hanlin12-AMD Mar 18, 2026
6443ef9
Merge branch 'vllm-project:main' into hip_online_tuning
hanlin12-AMD Apr 7, 2026
47744cf
add unit test for AITER hipBLASLt online tuning
hanlin12-AMD Apr 7, 2026
eccbced
fix typos in comment
hanlin12-AMD Apr 8, 2026
2e0a6a5
Merge branch 'vllm-project:main' into hip_online_tuning
hanlin12-AMD Apr 13, 2026
f08dd93
Merge branch 'vllm-project:main' into hip_online_tuning
hanlin12-AMD Apr 20, 2026
f33bfe5
Add AITER hipBLASLt GEMM kernel in vLLM
hanlin12-AMD Apr 21, 2026
879ccbe
Merge branch 'vllm-project:main' into hip_online_tuning
hanlin12-AMD Apr 21, 2026
7b56a01
Merge branch 'main' into hip_online_tuning
hanlin12-AMD Apr 21, 2026
ea9cef5
Update vllm/model_executor/kernels/linear/scaled_mm/aiter.py
hanlin12-AMD Apr 21, 2026
d44e5b8
Update vllm/_aiter_ops.py
hanlin12-AMD Apr 21, 2026
226e030
Remove the contiguous() after preshuffle
hanlin12-AMD Apr 21, 2026
50a8a1d
fix the env name and logic of aiter hipblaslt gemm and online tuning
hanlin12-AMD Apr 28, 2026
c4ff925
ensure VLLM_ROCM_USE_AITER_LINEAR_HIPBMM working
hanlin12-AMD Apr 28, 2026
2fdc8d0
Merge branch 'vllm-project:main' into aiter_hipbmm_online_tuning
hanlin12-AMD May 8, 2026
1ebc71e
Change the conditions of hipblaslt online tuning
hanlin12-AMD May 8, 2026
fde5878
Resolve the condition of hipBLASLt online tuning
hanlin12-AMD May 9, 2026
46bfb7b
Merge branch 'vllm-project:main' into aiter_hipbmm_online_tuning
hanlin12-AMD May 13, 2026
d001385
fix some variable name
hanlin12-AMD May 13, 2026
bdb9d33
fix missing line in aiter_ops
hanlin12-AMD May 15, 2026
98ed39b
Merge branch 'main' into aiter_hipbmm_online_tuning
tjtanaa May 27, 2026
30599ba
Merge branch 'main' into aiter_hipbmm_online_tuning
tjtanaa May 28, 2026
6b52d97
fix pre-commit
hanlin12-AMD May 28, 2026
6c0d85e
Add accuracy unit-test of Aiter hipBlaslt
hanlin12-AMD May 29, 2026
f6aed71
fix pre-commit
hanlin12-AMD May 29, 2026
df814ac
Merge branch 'main' into aiter_hipbmm_online_tuning
tjtanaa Jun 4, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading