Repository navigation

[Perf] [AMD] Kimi-K3: fuse attention-residual aggregation with TP collectives - #46656

Open

aryatsc wants to merge 9 commits into

sgl-project:mainfrom

modal-projects:devin/pr-attnres

Open

[Perf] [AMD] Kimi-K3: fuse attention-residual aggregation with TP collectives#46656
aryatsc wants to merge 9 commits into
sgl-project:mainfrom
modal-projects:devin/pr-attnres

Commits on Oct 26, 2026
- [ROCm][Kimi-K3] Fused MoE routing, sort, quant and epilogue
  
  aryatsc
  and
  devin-ai-integration[bot]
  committed
  d7b697b
- [ROCm][Kimi-K3] Static FP8 dense layers and tuned decode GEMMs
  
  aryatsc
  authored and
  devin-ai-integration[bot]
  committed
  9e442ff
- [ROCm][Kimi-K3] Fuse attention-residual aggregation with TP collectives
  
  aryatsc
  and
  devin-ai-integration[bot]
  committed
  54b78a2
- Merge branch 'main' into devin/pr-attnres
  aryatsc
  authored
  cc7f0af
- Merge branch 'main' into devin/pr-attnres
  aryatsc
  authored
  e6d6b32
Commits on Oct 28, 2026
- Merge branch 'main' into devin/pr-attnres
  aryatsc
  committed
  c8ab3fe
Commits on Nov 2, 2026
- Merge branch 'main' into devin/pr-attnres
  aryatsc
  committed
  1cda98c
Commits on Nov 5, 2026
- Merge remote-tracking branch 'origin/main' into m1105-attnres
  aryatsc
  committed
  befa2de
- [AMD] moe: Use the module-level zero_copy_context import in AiterRunnerCore.run
  
  aryatsc
  and
  devin-ai-integration[bot]
  committed
  a55e6d5