Repository navigation

[Feat][MM Cache] Skip media loading & decoding if UUID based cache lookup succeeds - #55583

Open

Jankwi wants to merge 10 commits into

vllm-project:mainfrom

Jankwi:feat/early-cache-lookup

Open

[Feat][MM Cache] Skip media loading & decoding if UUID based cache lookup succeeds#55583
Jankwi wants to merge 10 commits into
vllm-project:mainfrom
Jankwi:feat/early-cache-lookup

Commits on Sep 5, 2026
- Test that video loading is not skipped in the current implementation
  Jan Kwiecinski
  committed
  9b8363f
Commits on Sep 6, 2026
- Make it possible to skip media loadingfor video and images
  Jan Kwiecinski
  committed
  1a6a430
- Add skip_early_mm_lookup param to opt-out of early mm lookups per request
  Jan Kwiecinski
  committed
  5853f06
- Add docs for change
  Jan Kwiecinski
  committed
  0bade85
- Merge branch 'vllm-project:main' into feat/early-cache-lookup
  Jankwi
  authored
  46cd0e0
- Disable early lookups for vision chunks
  Jan Kwiecinski
  committed
  166ffdb
Commits on Sep 7, 2026
- Merge branch 'vllm-project:main' into feat/early-cache-lookup
  Jankwi
  authored
  5a234b2
Commits on Sep 11, 2026
- Remove env var and retry race condition failures
  Jan Kwiecinski
  committed
  3d28775
- Merge branch 'main' into feat/early-cache-lookup
  Jankwi
  authored
  623e1d2
Commits on Sep 23, 2026
- [DRAFT]: Simplify lookups
  Jan Kwiecinski
  committed
  30132ea