feat(prefill-probe): add learned prefill complexity router - #97

Merged

ryan-lempka merged 12 commits into

NVIDIA-NeMo:sabhatinas/switch-876-vllm-hidden-state-docsfrom

mich-xu:michxu/prefill-complexity-router

Jul 22, 2026

Commits on Jul 20, 2026

feat(prefill-probe): add learned artifact inference
mich-xu
committed
e41278b
feat(prefill-probe): add cost-aware routing policy
mich-xu
committed
f025f7c
feat(prefill-probe): add hidden-state feature extraction
mich-xu
committed
b621d4f
feat(prefill-probe): add vllm learned scorer
mich-xu
committed
a60ba03
feat(prefill-probe): add learned profile configuration
mich-xu
committed
4b03701
docs(prefill-probe): add deployment guide and sample config
mich-xu
committed
9fb6405
feat(prefill-probe): accept explicit probe input
mich-xu
committed
8ea2bd2
test(benchmark): inject explicit prefill probe input
mich-xu
committed
ae02bc7
docs(prefill-probe): document explicit probe input
mich-xu
committed
7f00b7f

Commits on Jul 22, 2026

feat(prefill-probe): extract Terminus task internally
mich-xu
committed
18bfa11
docs(prefill-probe): document stock Terminus routing
mich-xu
committed
83d55a7
refactor(prefill-probe): rename config field to checkpoint_dir
mich-xu
committed
242790e