Upstream Main: Fused Ops and Kernels, FSDP and Memory Fixes#35

Merged

fabianlim merged 8 commits intomainfrom

Jun 7, 2024

Commits on May 28, 2024

Linting and Formatting for FMS-Acceleration-Peft package (#24)
achew010
authored

Commits on May 29, 2024

Workaround Low-Mem-Mode Patch for GPTQ-LoRA (#26)

achew010
and
fabianlim
authored

Commits on May 30, 2024

Group memory field names with prefix and minor fixes (#27)
achew010
authored
Initial Addition of FusedOps and Kernels Plugin With Model Patcher (#25)
fabianlim
authored
fix fsdp casting issue for autogptq and fused ops (#28)
fabianlim
authored

Commits on Jun 2, 2024

Add MLP & QLoRA Fused Ops and Kernels, Mixtral (#29)
fabianlim
authored

Commits on Jun 7, 2024