@@ -11,7 +11,7 @@ It is recommended to use uv to install the dependencies for faster installation:
1111``` bash
1212pip install --upgrade pip
1313pip install uv
14- uv pip install " sglang[all]>=0.4.4.post2 " --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer-python
14+ uv pip install " sglang[all]>=0.4.4.post3 " --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer-python
1515```
1616
1717** Quick Fixes to Common Problems**
@@ -27,7 +27,7 @@ uv pip install "sglang[all]>=0.4.4.post2" --find-links https://flashinfer.ai/whl
2727## Method 2: From source
2828```
2929# Use the last release branch
30- git clone -b v0.4.4.post2 https://github.com/sgl-project/sglang.git
30+ git clone -b v0.4.4.post3 https://github.com/sgl-project/sglang.git
3131cd sglang
3232
3333pip install --upgrade pip
@@ -42,7 +42,7 @@ Note: For AMD ROCm system with Instinct/MI GPUs, do following instead:
4242
4343```
4444# Use the last release branch
45- git clone -b v0.4.4.post2 https://github.com/sgl-project/sglang.git
45+ git clone -b v0.4.4.post3 https://github.com/sgl-project/sglang.git
4646cd sglang
4747
4848pip install --upgrade pip
@@ -70,7 +70,7 @@ docker run --gpus all \
7070Note: For AMD ROCm system with Instinct/MI GPUs, it is recommended to use ` docker/Dockerfile.rocm ` to build images, example and usage as below:
7171
7272``` bash
73- docker build --build-arg SGL_BRANCH=v0.4.4.post2 -t v0.4.4.post2 -rocm630 -f Dockerfile.rocm .
73+ docker build --build-arg SGL_BRANCH=v0.4.4.post3 -t v0.4.4.post3 -rocm630 -f Dockerfile.rocm .
7474
7575alias drun=' docker run -it --rm --network=host --device=/dev/kfd --device=/dev/dri --ipc=host \
7676 --shm-size 16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined \
@@ -79,11 +79,11 @@ alias drun='docker run -it --rm --network=host --device=/dev/kfd --device=/dev/d
7979drun -p 30000:30000 \
8080 -v ~ /.cache/huggingface:/root/.cache/huggingface \
8181 --env " HF_TOKEN=<secret>" \
82- v0.4.4.post2 -rocm630 \
82+ v0.4.4.post3 -rocm630 \
8383 python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --host 0.0.0.0 --port 30000
8484
8585# Till flashinfer backend available, --attention-backend triton --sampling-backend pytorch are set by default
86- drun v0.4.4.post2 -rocm630 python3 -m sglang.bench_one_batch --batch-size 32 --input 1024 --output 128 --model amd/Meta-Llama-3.1-8B-Instruct-FP8-KV --tp 8 --quantization fp8
86+ drun v0.4.4.post3 -rocm630 python3 -m sglang.bench_one_batch --batch-size 32 --input 1024 --output 128 --model amd/Meta-Llama-3.1-8B-Instruct-FP8-KV --tp 8 --quantization fp8
8787```
8888
8989## Method 4: Using docker compose
0 commit comments