Double-buffer GPU activations for overlapping H2D copy with backward compute - #534

Merged

mmathew23 merged 10 commits into

unslothai:mainfrom

ruixiang63:double_buffers_backward

May 4, 2026

Commits on Apr 7, 2026

add doube buffers on GPU for backward pass
ruixiang63
committed
4a167f6
use cuda event to avoid race condition
ruixiang63
committed
8176e25
fix as suggestions
ruixiang63
committed
6210ff0
fix issues as suggested
ruixiang63
committed
fbf8fb5

Commits on Apr 9, 2026

Free buffer B on OOM and prioritize single-buffer fallback
ruixiang63
committed
25bf1d6
checking free VRAM to enable double buffering
ruixiang63
committed
710cc2f
add env variable to disable double buffer
ruixiang63
committed
18db07a
fix issues
ruixiang63
committed
51b878d
fix issues
ruixiang63
committed
135d9dc
fix as suggestions
ruixiang63
committed
ec5e7a4