QVAC-11621 fix: KV cache memory validation to prevent OOM crashes#1642

Closed

simon-iribarren wants to merge 15 commits into

tetherto:mainfrom

simon-iribarren:fix/qvac-11621-kv-cache-memory-validation

Commits on Apr 20, 2026

fix: add memory validation before KV cache allocation to prevent OOM crashes (QVAC-11621)
simon-iribarren
committed
doc: add memory-safe-loading example showing OOM prevention error handling
simon-iribarren
committed
doc: use SDK model constant in memory-safe-loading example
simon-iribarren
committed
fix: use totalMemory heuristic instead of unreliable freemem()
simon-iribarren
committed
fix: remove ctx_size upper bound from schema, let memory validator handle it
simon-iribarren
committed
fix: always run memory validation even when stat fails
simon-iribarren
committed
fix: correct KV cache per-token estimates by ~100x
simon-iribarren
committed
test: add error-memory-exceeded test case for mobile + desktop
simon-iribarren
committed
feat: add memoryValidation config flag to disable pre-load memory checks
simon-iribarren
committed
mod: rename memoryValidation to unsafeDisableMemoryValidation
simon-iribarren
committed
test: add memory validation e2e tests for mobile coverage
simon-iribarren
committed
fix: calibrate memory estimator to prevent false positives on mobile
simon-iribarren
committed
feat: read GGUF metadata for exact KV cache memory computation
simon-iribarren
committed
mod: remove SDK-side KV cache memory validation
simon-iribarren
committed
Revert "mod: remove SDK-side KV cache memory validation"
simon-iribarren
committed