Skip to content

cuda: backport upstream revert of "reset cuda context after reading memory size" (#24715) - #238

Merged
TheTom merged 2 commits into
TheTom:feature/turboquant-kv-cachefrom
min23asdw:fix/cuda-device-reset-after-model-reload
Jul 30, 2026
Merged

TheTom merged 2 commits into
TheTom:feature/turboquant-kv-cachefrom
min23asdw:fix/cuda-device-reset-after-model-reload

Commits

Commits on Jul 27, 2026