Repository navigation

[TRTLLM-16212][feat] Unified caching via TRTLLM_CACHE_DIR environment variable - #18897

Merged

Funatiq merged 14 commits into

NVIDIA:mainfrom

AlessioNetti:unified-caching

Oct 13, 2026

Merged

[TRTLLM-16212][feat] Unified caching via TRTLLM_CACHE_DIR environment variable#18897
Funatiq merged 14 commits into
NVIDIA:mainfrom
AlessioNetti:unified-caching

Commits on Sep 28, 2026
- [WiP] Unified caching implementation
  AlessioNetti
  committed
  9a83ce7
- Enable DeepGEMM cubin dump automatically if TRTLLM_DG_CACHE_DIR is set
  AlessioNetti
  committed
  c4e5943
- Fix interaction between TRTLLM_CACHE_DIR and flashinfer isolation, add tests
  AlessioNetti
  committed
  33b86f7
- Simplify cache resolution logic in trtllm-llmapi-launch
  AlessioNetti
  committed
  6151d9a
- Check for unset $HOME in trtllm-llmapi-launch
  AlessioNetti
  committed
  a32f1c8
- Enable flashinfer isolation by default when TRTLLM_CACHE_DIR is set
  AlessioNetti
  committed
  4ff818e
- Preserve worker isolation in DeepGEMM + Ray
  AlessioNetti
  committed
  a94083e
- Fix unified cache handling in trtllm-llmapi-launch
  AlessioNetti
  committed
  ffbe18f
- Fiix trtllm-llmapi-launch under set -Eeo pipefail
  
  AlessioNetti
  and
  BowenFu
  committed
  feefec3
- Add minimal documentation for DeepGEMM caching env vars
  AlessioNetti
  committed
  1019fde
- Match home dir expansion in Python and LLM API script paths, linting fixes
  AlessioNetti
  committed
  b5438c2
Commits on Oct 7, 2026