Skip to content

optimize attention init - #4240

Draft
wdykas wants to merge 14 commits into
NVIDIA:mainfrom
wdykas:attention-init-optimize
Draft

optimize attention init#4240
wdykas wants to merge 14 commits into
NVIDIA:mainfrom
wdykas:attention-init-optimize

Commits

Commits on Apr 9, 2026

Commits on Apr 10, 2026

Commits on Apr 13, 2026

  • clean up

    author
    William Dykas
    committed
    4c8e6fc

  • removing benchmark scripts

    author
    William Dykas
    committed
    ba210d3

  • remove random comment

    author
    William Dykas
    committed
    731f1d1

  • remove the 3 assign

    author
    William Dykas
    committed
    2df82bc

  • revert

    author
    William Dykas
    committed
    2a6e15c

  • cleanup

    author
    William Dykas
    committed
    4cfae64

  • clean up

    author
    William Dykas
    committed
    25517f5

Commits on Apr 14, 2026

  • changes

    author
    William Dykas
    committed
    4ac3f9a

  • fix

    rootroot
    root
    authored and
    root
    committed
    6e8808c

  • clean up, remove sampling perf fix

    rootroot
    root
    authored and
    root
    committed
    f5f05b5

  • clean up

    rootroot
    root
    authored and
    root
    committed
    b5f55d7