Repository navigation

[Bug-fix] Measure KV transfer speed per actual transfer for disaggregation (Mooncake) - #31993

Closed

hunhokim wants to merge 5 commits into

sgl-project:mainfrom

hunhokim:bug-fix/chunked-prefill-kv-transfer

Closed

[Bug-fix] Measure KV transfer speed per actual transfer for disaggregation (Mooncake)#31993
hunhokim wants to merge 5 commits into
sgl-project:mainfrom
hunhokim:bug-fix/chunked-prefill-kv-transfer

Commits on Jul 21, 2026
- Define transfer_metric on Req and snapshot it before teardown
  
  Hun-ho Kim
  and
  claude
  committed
  74c5cd9
- Measure KV transfer metrics on every transfer
  
  Hun-ho Kim
  and
  claude
  committed
  581c154
- Skip transfer-metric estimate on dummy CP ranks
  
  Hun-ho Kim
  and
  claude
  committed
  ad4e229
- Add unit tests for measured KV transfer metrics
  
  Hun-ho Kim
  and
  claude
  committed
  f89151d
Commits on Jul 23, 2026
- Clarify KV-transfer-metric test comments
  
  Hun-ho Kim
  and
  claude
  committed
  8400671