diff --git a/docs/design/torch_compile_multimodal.md b/docs/design/torch_compile_multimodal.md index 8b745c8ce233..bb30de56bc14 100644 --- a/docs/design/torch_compile_multimodal.md +++ b/docs/design/torch_compile_multimodal.md @@ -88,7 +88,7 @@ If compilation fails for a multimodal model: 1. **Disable and test**: First verify the model works without compilation: ```bash - VLLM_TORCH_COMPILE_LEVEL=0 vllm serve --compilation-config='{"compile_mm_encoder":"false"}' + vllm serve --compilation-config='{"mode":0,"compile_mm_encoder":"false"}' ``` 2. **Check logs**: Enable debug logging to see compilation details: