Skip to content

[Core] Increase default max_num_batched_tokens for multimodal models #11217

[Core] Increase default max_num_batched_tokens for multimodal models

[Core] Increase default max_num_batched_tokens for multimodal models #11217

Annotations

2 warnings

The logs for this run have expired and are no longer available.