Repository navigation
[Observability] add model initializing duration log - #52141
Conversation
|
Friendly ping @22quinn |
|
This pull request has merge conflicts that must be resolved before it can be |
Signed-off-by: Andy Xie <andy.xning@gmail.com>
8777545 to
1a9738f
Compare
|
Friendly ping. @22quinn |
simon-mo
left a comment
There was a problem hiding this comment.
AI-assisted review performed on behalf of Simon Mo. Reviewed commit 8e3b88746cf08ae555ee18e560e4b53dfd2f42f1.
No blocking findings. The timer brackets model construction only, uses a monotonic clock, and preserves the weight-loading/post-processing order. A focused CPU probe executed the unchanged load_model method with a controlled clock and real torch module; it confirmed the duration, call order, and returned eval-mode model. Full GPU execution was not run locally; normal CI remains required.
simon-mo
left a comment
There was a problem hiding this comment.
AI-assisted re-review on behalf of Simon Mo at 06199eae21b9b3462a14774f79001a50e0c2b501. Compared the current diff with the previously reviewed change: identical. Re-ran the focused CPU timing/weight-loader probes against these current-head files (3 passed). Approval remains valid; required upstream CI must pass before merge.
|
/ci run |
|
❌ This PR is 10 commits behind upstream |
simon-mo
left a comment
There was a problem hiding this comment.
AI-assisted review on behalf of Simon Mo after updating the branch against main. Reviewed c2183183c7fd31242372951e87b630bf16ea28c9; the PR diff is byte-for-byte identical to the change already reviewed and CPU-tested. No new blocking findings. Required CI remains the merge gate.
|
/ci run |
|
✅ Triggered Buildkite CI #92263 for commit |
|
AI-assisted CI follow-up from Simon’s agent: both this PR and #51792 are blocked by the same existing-main test-fixture mismatch, not by the logging change. Buildkite 92263 fails all five MiniMax PP cases in I checked base/main vllm_config=SimpleNamespace(
model_config=SimpleNamespace(hf_text_config=config),
quant_config=None,
use_v2_model_runner=False,
speculative_config=None,
)@andyxning could you add this fixture correction (preferably once upstream, then update both branches), and run the five existing PP tests? I’ll re-review the resulting heads, restart CI, and merge once required checks pass. A blind retry won’t resolve these deterministic failures. This build also has a separate API-server metrics failure: |
simon-mo
left a comment
There was a problem hiding this comment.
AI-assisted re-review for Simon: refreshed against current main including the MiniMax PP fixture correction (#59508). The PR diff is byte-identical to the previously reviewed logging change. Focused CPU review probes pass; required hosted CI remains the merge gate.
|
/ci run |
|
@andyxning the shared MiniMax PP fixture mismatch is now fixed upstream by #59508. I updated this branch to main, verified the PR diff is unchanged, reran the three focused logging probes, refreshed approval on the new head, and requested a new CI build. No separate fixture fix is needed from you now. I will also check whether the API-server metrics failure recurs before merging. (AI-assisted follow-up for Simon.) |
|
✅ Triggered Buildkite CI #92306 for commit |
Signed-off-by: Andy Xie <andy.xning@gmail.com>
Purpose
Add model initializing duration log
Test Plan
NA
Test Result
NA
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.