Skip to content

feat: KV cache quantization support in fp8 rollout in GRPO#1212

Merged
terrykong merged 44 commits into
NVIDIA-NeMo:mainfrom
sharonyu-115:kv-cache-fp8
Dec 2, 2025
Merged

feat: KV cache quantization support in fp8 rollout in GRPO#1212
terrykong merged 44 commits into
NVIDIA-NeMo:mainfrom
sharonyu-115:kv-cache-fp8

add requires_kv_scale_sync property to GenerationInterface

db3ea88
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Dec 2, 2025 in 1s

DCO

All commits are signed off!