Use pin_memory in forward_batch.init_new to reduce decoding latency#21360
Open
litmei wants to merge 13 commits intosgl-project:mainfrom
Open
Use pin_memory in forward_batch.init_new to reduce decoding latency#21360litmei wants to merge 13 commits intosgl-project:mainfrom
litmei wants to merge 13 commits intosgl-project:mainfrom
Commits
Commits on Mar 25, 2026
- committed
- committed
Commits on Mar 27, 2026
Commits on Mar 30, 2026
Commits on Apr 1, 2026
- authored
- committed
- committed
Commits on Apr 6, 2026
Commits on Apr 7, 2026
- committed
- committed
Commits on Apr 8, 2026
- committed
Commits on Apr 9, 2026
Commits on Apr 10, 2026
- committed