Skip to content

feat: KV cache quantization support in fp8 rollout in GRPO#1212

Merged
terrykong merged 44 commits into
NVIDIA-NeMo:mainfrom
sharonyu-115:kv-cache-fp8
Dec 2, 2025
Merged

feat: KV cache quantization support in fp8 rollout in GRPO#1212
terrykong merged 44 commits into
NVIDIA-NeMo:mainfrom
sharonyu-115:kv-cache-fp8

add requires_kv_scale_sync property to GenerationInterface

db3ea88
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Dec 2, 2025 in 0s

27.72% of diff hit (target 80.00%)

View this Pull Request on Codecov

27.72% of diff hit (target 80.00%)

View more details on Codecov