add dtype and max_num_batched_tokens to classify example so that it can be run out of box#24965
Open
chenfengjin wants to merge 3 commits intovllm-project:mainfrom
Open
add dtype and max_num_batched_tokens to classify example so that it can be run out of box#24965chenfengjin wants to merge 3 commits intovllm-project:mainfrom
chenfengjin wants to merge 3 commits intovllm-project:mainfrom