[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued)#43209

Merged

Harry-Chen merged 16 commits into

vllm-project:mainfrom

cleonard530:new-stable-abi-phase7

May 23, 2026

Commits on May 20, 2026

Move pos_encoding kernel file from csrc to csrc/libtorch_stable

mikaylagawarecki
authored and
cleonard530
committed
[k/n] Migrate rotary_embedding to torch stable ABI

mikaylagawarecki
authored and
cleonard530
committed
Move fused_qknorm_rope kernel file from csrc to csrc/libtorch_stable

mikaylagawarecki
authored and
cleonard530
committed
[l/n] Migrate fused_qk_norm_rope to torch stable ABI

mikaylagawarecki
authored and
cleonard530
committed
Move layernorm kernel file from csrc to csrc/libtorch_stable

mikaylagawarecki
authored and
cleonard530
committed
[m/n] Migrate layernorm kernels (rms_norm, fused_add_rms_norm) to torch stable ABI

mikaylagawarecki
authored and
cleonard530
committed
Move layernorm quant kernel file from csrc to csrc/libtorch_stable

mikaylagawarecki
authored and
cleonard530
committed
[n/n] Migrate layernorm quant kernels (rms_norm_static_fp8_quant, fused_add_rms_norm_static_fp8_quant) to torch stable ABI

mikaylagawarecki
authored and
cleonard530
committed
Move fused layernorm dynamic per-token quant files from csrc to csrc/libtorch_stable

mikaylagawarecki
authored and
cleonard530
committed
Migrate fused_layernorm_dynamic_per_token_quant to torch stable ABI

mikaylagawarecki
authored and
cleonard530
committed
cleaned up a ifndef USE_ROCM that was accidentally reintroduce in a cherry-pick merge conflict
cleonard530
committed
updated TROCH_CHECK to STD_TORCH_CHECK in csrc/libtorch_stable/fused_qknorm_rope_kernel.cu that I missed when resolving merge conflict. Also, added comments in csrc/ops.h describing that some of th…
cleonard530
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued)#43209

[7/n] Migrate pos_encoding and norm kernels to libtorch stable ABI (continued)#43209
Harry-Chen merged 16 commits into
vllm-project:mainfrom
cleonard530:new-stable-abi-phase7

Commits on May 20, 2026

Move pos_encoding kernel file from csrc to csrc/libtorch_stable

[k/n] Migrate rotary_embedding to torch stable ABI

Move fused_qknorm_rope kernel file from csrc to csrc/libtorch_stable

[l/n] Migrate fused_qk_norm_rope to torch stable ABI

Move layernorm kernel file from csrc to csrc/libtorch_stable

[m/n] Migrate layernorm kernels (rms_norm, fused_add_rms_norm) to torch stable ABI

Move layernorm quant kernel file from csrc to csrc/libtorch_stable

[n/n] Migrate layernorm quant kernels (rms_norm_static_fp8_quant, fused_add_rms_norm_static_fp8_quant) to torch stable ABI

Move fused layernorm dynamic per-token quant files from csrc to csrc/libtorch_stable

Migrate fused_layernorm_dynamic_per_token_quant to torch stable ABI

cleaned up a ifndef USE_ROCM that was accidentally reintroduce in a cherry-pick merge conflict

updated TROCH_CHECK to STD_TORCH_CHECK in csrc/libtorch_stable/fused_qknorm_rope_kernel.cu that I missed when resolving merge conflict. Also, added comments in csrc/ops.h describing that some of th…

Commits on May 21, 2026

Merge branch 'main' into new-stable-abi-phase7

The double inclusion in csrc/quantization/fused_kernels/fused_silu_mul_block_quant.cu of ../w8a8/fp8/common.cuh (included already through libtorch_stable/quantization/fused_kernels/quant_conversion…

Commits on May 22, 2026

Merge branch 'main' into new-stable-abi-phase7

Merge branch 'main' into new-stable-abi-phase7