Repository navigation
fix(replay): keep timing and capacity on the selected database version (cherry-pick #291) - #344
Merged
Merged
Conversation
#291) * fix(ci): align public Rust schema contract (#78) (#79) (cherry picked from commit 01d104e) Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(compliance): address OSRB filing requirements (#81) (#92) * fix(compliance): remediate OSRB filing requirements * fix(ci): stop archiving wheels in GitHub Actions * feat(ci): stage wheels in Artifactory * fix(ci): run wheel staging with bash * fix(codeowners): classify root dockerignore * docs(legal): reproduce Transformers license * fix(compliance): preserve provenance and legal payloads * fix(ci): validate wheels before staging * chore(codeowners): route compliance tests --------- (cherry picked from commit aab4635) Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> Co-authored-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(generator): serialize attention backend before save (#88) (#93) (cherry picked from commit 99d1d22) Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(generator): preserve Sweeper KV capacity [6738325] (#127) (#133) * fix(generator): preserve Sweeper KV capacity [6738325] * fix(generator): preserve fixed capacity for TRT-LLM rc23 --------- (cherry picked from commit 58a5e18) Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(generator): render SGLang candidate token limits [6738246] (#128) (#134) * fix(generator): render SGLang candidate token limits [6738246] * refactor(generator): isolate SGLang token lowering --------- (cherry picked from commit ffcb657) Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(compliance): complete third-party license notices (#95) (#148) (cherry picked from commit 4b1b5dc) Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> * chore: canonicalize repository governance files (#106) (#149) * chore: canonicalize repository governance files * fix(docs): keep packaged governance links resolvable --------- (cherry picked from commit d83e056) Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> Co-authored-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * Harden SPDX checks and correct 50 Jinja license headers (#146) (#150) * ci: validate complete SPDX license identifiers * fix: make Jinja SPDX identifiers machine-readable * docs: add literal DCO sign-off command * docs: explain wheel-local legal file copies * docs: align replay parity reference with Apache-2.0 * fix: require closing SPDX block delimiters * fix: reject dangling SPDX comment delimiters --------- (cherry picked from commit 82de117) Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> Co-authored-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(cli): preserve whole-model FPM FMHA identity [6745146] (#151) (#154) (cherry picked from commit b6b0a38) Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(generator): omit unspecified SGLang KV-cache dtype [6745807] (#152) (#155) (cherry picked from commit e7ea5d9) Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(packaging): backport manylinux 2.28 wheel repair (#205) * fix(packaging): repair Linux wheels for manylinux 2.28 (#202) * fix(packaging): repair Linux wheels for manylinux 2.28 Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> * fix(ci): use bundled Python in manylinux jobs Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * test(packaging): verify manylinux repair behavior and pin Rust Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> --------- Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> Co-authored-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(ci): build staged wheels for glibc 2.28 --------- Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> Co-authored-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(cli): resolve prediction backend versions on 0.12.0 Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(replay): apply authored versions before capacity estimation Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(replay): preserve null aliases and custom version roots Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(replay): align capacity systems root Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * style: format custom-root regression Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(epd): resolve omitted backend versions Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * test(epd): cover version lookup boundaries Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> * fix(replay): retain the canonical timing database root Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> --------- Signed-off-by: Jason Zhou (Engrg-Hardware 1) <jasonzho@nvidia.com> Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com> Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com> (cherry picked from commit 7836e7b)
simone-chen
approved these changes
Sep 29, 2026
This branch was previously deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Cherry-pick of 7836e7b (#291) into
release/0.12.1.Conflict resolution
release/0.12.1predates several main-only features, so only the bugfix itself is ported:aisimulate/aic.py(capacity.pyon main):aic_backend_version, falling back tobackend_version.get_latest_database_version(imported fromaiconfigurator_coreon this branch) instead of the hardcodedDEFAULT_BACKEND_VERSIONS.systems_pathso it reads the same database root. Release timing only supportssystems_path, so thesystems_paths/resolve_systems_pathshandling is not ported.memory_diagnostics, and MoE controls. None of these exist on this branch.aisimulate/runner.py: before the capacity preflight, the authored/deployment backend version is now passed to capacity and timing. Left out:memory_diagnosticsand the slot-aliasresolved_versionhandling, which don't exist on this branch.config/epd.py,tests/test_epd_cli.py: not on this branch, so they are dropped.tests/test_runner.py: the two new tests depend on main-only features (slot aliases,systems_paths, canonical lowering,_runtime), so they are not ported.tests/test_aic.py: imports now come fromaiconfigurator_core. Thetiming_modelassertion for default timing is left out because the release compiler does not emittiming_modelfor default timing.