Pin bitsandbytes to continuous-release_main on ROCm (4-bit decode fix)#4954

Merged

danielhanchen merged 8 commits into

mainfrom

fix/rocm-bnb-prerelease

Apr 10, 2026

Commits on Apr 10, 2026

Pin bitsandbytes to continuous-release_main on ROCm for 4-bit decode fix
danielhanchen
committed
Drop Studio ROCm 16-bit fallback now that bnb 0.50+ fixes 4-bit decode
danielhanchen
committed
Cache _bnb_rocm_4bit_ok() with functools.cache
danielhanchen
committed
Shorten verbose bnb/ROCm comments
danielhanchen
committed
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
Remove _bnb_rocm_4bit_ok safety net from inference.py
danielhanchen
committed
Drop audio/vision ROCm guard in inference.py — verified unblocked by bnb fix
danielhanchen
committed
Shorten max_seq_length=0 guard comment to one line
danielhanchen
committed