Fix: Enhance ModelConfig for kv cache size calculations#5868
Merged
hlu1 merged 5 commits intoNVIDIA:mainfrom Jul 16, 2025
Merged
Fix: Enhance ModelConfig for kv cache size calculations#5868hlu1 merged 5 commits intoNVIDIA:mainfrom
hlu1 merged 5 commits intoNVIDIA:mainfrom
Commits
Commits on Jul 16, 2025
- authored andcommitted
- authored andcommitted
- authored andcommitted
- authored andcommitted
- authored andcommitted
