Skip to content

[GLM-5.3 Flash] Serving optimizations: KDA/mHC fusion, DSA draft metadata graphs, prefill autotuning - #39422

Draft
JustinTong0323 wants to merge 10 commits into
mainfrom
xinyuan/glm53flash-sota-perf
Draft

JustinTong0323 wants to merge 10 commits into
mainfrom
xinyuan/glm53flash-sota-perf

[Perf] Reuse CPU token counts for ordinary KDA prefill

36e3696
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar