Repository navigation

feat(routing): add prompt-cache affinity - #8008

Merged

diegosouzapw merged 7 commits into

cheaper-inference:release/v3.8.49from

JxnLexn:dev/feat/prompt-cache-local-routing

Jul 22, 2026

Merged

feat(routing): add prompt-cache affinity#8008
diegosouzapw merged 7 commits into
cheaper-inference:release/v3.8.49from
JxnLexn:dev/feat/prompt-cache-local-routing

Commits on Jul 21, 2026
- Add prompt cache locality routing
  JxnLexn
  committed
  cff13bd
- fix: preserve weighted cache-affinity routing
  JxnLexn
  committed
  42fdf83
- feat(routing): add cache-optimized combos
  JxnLexn
  committed
  c3a9352
- fix(routing): preserve normal ordering on cache misses
  JxnLexn
  committed
  f7abef7
- fix(routing): bind cache affinity to concrete accounts
  JxnLexn
  committed
  0bb182b
Commits on Jul 22, 2026
- Merge remote-tracking branch 'origin/release/v3.8.49' into dev/feat/prompt-cache-local-routing
  diegosouzapw
  committed
  d1705d8
- feat(routing): add prompt-cache affinity + align combo-auto-config test with new defaults
  
  JxnLexn
  and
  diegosouzapw
  committed
  dbb3e50