Skip to content

Commit 3301131

Browse files
authored
Fix broken example: examples/offline_inference/profiling at scheduler_config (#18117)
1 parent 4f8b373 commit 3301131

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/offline_inference/profiling.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -193,7 +193,7 @@ def run_profile(context: ProfileContext, csv_output: Optional[str],
193193
batch_size = context.batch_size
194194
prompt_len = context.prompt_len
195195

196-
scheduler_config = llm.llm_engine.scheduler_config
196+
scheduler_config = llm.llm_engine.vllm_config.scheduler_config
197197
max_model_len = llm.llm_engine.model_config.max_model_len
198198
max_num_batched_tokens = scheduler_config.max_num_batched_tokens
199199
max_num_seqs = scheduler_config.max_num_seqs

0 commit comments

Comments
 (0)