feat(inference): support sliding-window attention in the dynamic batc… - #5138

feat(inference): support sliding-window attention in the dynamic batc…#5138

shanmugamr1992 wants to merge 1 commit into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

shanmugamr1992:shanmugamr/swa-dynamic-inferenceshanmugamr1992/Megatron-LM:shanmugamr/swa-dynamic-inferenceCopy head branch name to clipboard