Skip to content

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement#29558

Merged
ProExpertProg merged 11 commits into
mainfrom
wentao-enable-cudagraph-for-deepepHT
Dec 7, 2025
Merged

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement#29558
ProExpertProg merged 11 commits into
mainfrom
wentao-enable-cudagraph-for-deepepHT

Commits

Commits on Nov 27, 2025

Commits on Dec 1, 2025

Commits on Dec 3, 2025

Commits on Dec 5, 2025

Commits on Dec 6, 2025

Commits on Dec 7, 2025