refactor(attention): cache YaRN concentration factor in Attention.__i… - #5

refactor(attention): cache YaRN concentration factor in Attention.__i…#5

cuichenx merged 1 commit into

cuichenx:iris-pr5138-pr5140-dynamic-swa-sink-fixescuichenx/Megatron-LM:iris-pr5138-pr5140-dynamic-swa-sink-fixesfrom

shanmugamr1992:address-santhnm-yarn-cache-pr5249shanmugamr1992/Megatron-LM:address-santhnm-yarn-cache-pr5249Copy head branch name to clipboard