Skip to content

QK logits clipping (non-split version) - #1929

Merged
BoxiangW merged 40 commits into
NVIDIA:mainfrom
BoxiangW:boxiangw/muon-clip
Dec 10, 2025
Merged

QK logits clipping (non-split version)#1929
BoxiangW merged 40 commits into
NVIDIA:mainfrom
BoxiangW:boxiangw/muon-clip

Commits

Commits on Sep 25, 2025

  • Add qk-clip

    BoxiangWBoxiangW
    committed
    0ef342c

Commits on Sep 26, 2025

  • w/o EP working

    BoxiangWBoxiangW
    committed
    a5d2ea8

  • Lint

    BoxiangWBoxiangW
    committed
    978b99b

Commits on Sep 29, 2025

Commits on Oct 1, 2025

Commits on Oct 9, 2025

  • Fix qkclip issue

    BoxiangWBoxiangW
    committed
    c370cdd

  • Fix bug

    BoxiangWBoxiangW
    committed
    6f8f77d

Commits on Oct 10, 2025

  • Fix TP usage

    BoxiangWBoxiangW
    committed
    527075f

  • Fix Lint

    BoxiangWBoxiangW
    committed
    3cebc1f

  • Fix import and error log

    BoxiangWBoxiangW
    committed
    e3c468f

  • lint

    BoxiangWBoxiangW
    committed
    ef995ea

Commits on Oct 16, 2025

  • Address comments

    BoxiangWBoxiangW
    committed
    7f5f1e2

  • Lint

    BoxiangWBoxiangW
    committed
    65fc829

Commits on Oct 17, 2025

  • Added GQA QK Clipping

    BoxiangWBoxiangW
    committed
    75ee38c

  • Lint

    BoxiangWBoxiangW
    committed
    a1c0ff6

Commits on Oct 24, 2025

Commits on Nov 3, 2025

Commits on Nov 5, 2025

Commits on Nov 8, 2025

Commits on Nov 10, 2025

Commits on Nov 20, 2025

Commits on Dec 3, 2025

Commits on Dec 8, 2025

Commits on Dec 9, 2025

Commits on Dec 10, 2025