Skip to content

[Core] Increase default max_num_batched_tokens for multimodal models #20672

[Core] Increase default max_num_batched_tokens for multimodal models

[Core] Increase default max_num_batched_tokens for multimodal models #20672

Annotations

2 warnings

This job succeeded