Skip to content

Skip uv check for pre-release bitsanbytes#5019

Closed
martinhoyer wants to merge 2 commits intounslothai:mainfrom
martinhoyer:rocm-bitsandbytes-wheel
Closed

Skip uv check for pre-release bitsanbytes#5019
martinhoyer wants to merge 2 commits intounslothai:mainfrom
martinhoyer:rocm-bitsandbytes-wheel

Conversation

@martinhoyer
Copy link
Copy Markdown
Contributor

Workaround for the 'main' wheel version not matching its filename (0.50.0.dev0 != 1.33.7rc0).

Alternative to #4966, which resolves the same issue by not using uv.

The 'main' wheel version does not match filename
(0.50.0.dev0 != 1.33.7rc0).
Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the install.sh script to include a workaround for a version mismatch error during the installation of bitsandbytes for AMD ROCm. It introduces the UV_SKIP_WHEEL_FILENAME_CHECK=1 environment variable to the uv pip install command to bypass filename validation. I have no feedback to provide.

@martinhoyer
Copy link
Copy Markdown
Contributor Author

ah, so the #4966 was merged in the meantime. Well, do as you wish with this PR.

Supersedes the pip-bootstrap approach from unslothai#4966. Drops the ensurepip
block and reverts both install paths to uv; UV_SKIP_WHEEL_FILENAME_CHECK
handles the continuous-release_main wheel's filename/metadata mismatch
without mixing package managers in the studio venv.
@rolandtannous
Copy link
Copy Markdown
Collaborator

rolandtannous commented Apr 14, 2026

Pushed a merge of main onto this branch. Dropped the ensurepip bootstrap that came in via #4966 and kept your uv + UV_SKIP_WHEEL_FILENAME_CHECK approach on the pre-release install; also reverted the PyPI fallback back to uv pip install since it never had the filename mismatch. Net: one package manager in the venv, and the comment now lives next to the install command.

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: bcc2b83cb8

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread install.sh
# uv rejects the continuous-release_main wheel because its filename
# version (1.33.7rc0) disagrees with the embedded metadata version
# (0.50.0.dev0); UV_SKIP_WHEEL_FILENAME_CHECK is uv's escape hatch.
if run_install_cmd "$_label (pre-release)" env UV_SKIP_WHEEL_FILENAME_CHECK=1 uv pip install --python "$_venv_py" \
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Use a supported uv knob to bypass wheel filename checks

UV_SKIP_WHEEL_FILENAME_CHECK=1 is not a recognized uv pip install setting on the supported uv range here (I checked uv pip install --help, and reproduced on uv 0.7.22 that installs still fail with Wheel version does not match filename). Because this script only enforces uv>=0.7.14, the pre-release ROCm wheel path will continue to fail on many valid installations and immediately fall back to PyPI, which this same function documents as still broken for ROCm 4-bit decode.

Useful? React with 👍 / 👎.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

well, it was added in 0.8.23, but that's more of a issue with not bumping up minimal uv version.

@rolandtannous
Copy link
Copy Markdown
Collaborator

Closing in favor of #4966.

UV_SKIP_WHEEL_FILENAME_CHECK was added in uv 0.8.23 (astral-sh/uv#16046, released 2025-10-04), and install.sh's uv floor is UV_MIN_VERSION=0.7.14. Any user on uv <0.8.23 silently ignores the env var and falls through to the PyPI wheel that this same function documents as broken for ROCm 4-bit decode — which is exactly what codex's P1 caught and reproduced on uv 0.7.22. Bumping the installer's uv floor by a full minor series just to keep bnb install on a single package manager isn't worth the user-visible floor change. #4966's pip-based path works across the full supported uv range, so it stays.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants