[Tokenizer] Validate caller token IDs against the vocab and active multimodal markers - #41735

[Tokenizer] Validate caller token IDs against the vocab and active multimodal markers#41735

rodamani wants to merge 4 commits into

sgl-project:mainsgl-project/sglang:mainfrom

modal-projects:rohan/up/mm-caller-token-id-validationmodal-projects/sglang:rohan/up/mm-caller-token-id-validationCopy head branch name to clipboard