Repository navigation
Fix NVIDIA workload startup settings and Docker readiness - #81
Merged
Merged
Conversation
Cap GLM-5.3 H200 context, migrate the DeepSeek FP4 indexer flag, and fail readiness promptly for stopped or removed Docker containers. Run lifecycle regression tests in the CPU pipeline step. Co-Authored-By: GPT-6 <noreply@openai.com> Signed-off-by: khluu <khluu000@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fix two NVIDIA workload startup settings and stop holding GPU hosts after a Docker server has exited.
This PR was authored with assistance from OpenAI Codex (GPT-6).
Changes
use_fp4_indexer_cache=Trueflag with--attention-config.indexer_kv_dtype=mxfp4, preserving the old setting's meaning. Build #568 reached a GPU host but failed argument validation on the old flag.--rm. In #567, GLM's engine failed around 13:40 UTC but readiness held the host until 14:20 UTC. Keep the native-process check, reset runtime tracking at startup, and try to print the last container logs on failure.Validation
shellcheck lib/server.sh, shell syntax checks,git diff --check, and Buildkite's full online pipeline-schema validation passed.Remaining failures from #567
This addresses perf-eval configuration and lifecycle behavior. Completing NVIDIA recovery also requires:
AMD workload definitions and GPU scheduling policy are unchanged.