KVCache and Intelligent Routing for HyperPod Inference#290

Merged

mollyheamazon merged 3 commits intoaws:mainfrom

rvasahu-amazon:main

Oct 28, 2025

Commits on Oct 27, 2025

feat: KVCache and Intelligent Routing for HyperPod Inference
rvasahu-amazon
committed

Commits on Oct 28, 2025

Initial commit for kv-cache and intelligent support in inference SDK/CLI (#252)

jiapinw
authored and
rvasahu-amazon
committed
fix: update inference template.py to reflect init experience template submission changes
rvasahu-amazon
committed