[Pytorch] Integrate GPT OSS Swiglu in TransformerLayer - #2312

Merged

ptrendx merged 13 commits into

NVIDIA:mainfrom

vthumbe1503:clamped_swiglu_in_transformer

Oct 29, 2025

Commits on Oct 28, 2025

changes working
vthumbe1503
committed
e507e1a
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
962bb5c
add support for onnx, minor comments
vthumbe1503
committed
9ea053a
Merge branch 'clamped_swiglu_in_transformer' of github.com:vthumbe1503/TransformerEngine into clamped_swiglu_in_transformer
vthumbe1503
committed
35618bd
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
fea046e
greptile review comments
vthumbe1503
committed
1c61faf
merge conflict
vthumbe1503
committed
9bf4cd8
Update transformer_engine/pytorch/transformer.py

vthumbe1503
and
ptrendx
authored
261049b
Update transformer_engine/pytorch/module/layernorm_mlp.py

vthumbe1503
and
ptrendx
authored
d585c3e
Update transformer_engine/pytorch/transformer.py

vthumbe1503
and
ptrendx
authored
5d7a46f
address review comments
vthumbe1503
committed
5901db5
address review comments
vthumbe1503
committed
3ea3237
revert the name change
vthumbe1503
committed
d5a68ab