Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
c1b3cbf
Studio: drop the speculative drafter under Auto when only the model f…
danielhanchen Aug 11, 2026
fda5205
Merge origin/main (DFlash drafter #8338) into studio-drafter-vram-drop
danielhanchen Aug 11, 2026
21dee65
Do not charge a repository drafter the extras replace, nor a partial …
danielhanchen Aug 11, 2026
b6fb823
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
4176b60
Fix the drafter drop: ngram capability, extras drafters, GPU subsets …
danielhanchen Aug 11, 2026
d9b7e7c
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
9daf6ba
Probe the layer load a tensor request falls back to, and cap it per d…
danielhanchen Aug 11, 2026
dbccfda
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
23d2b13
Release the drafter reserve on drop, and charge a remote extra-args d…
danielhanchen Aug 11, 2026
6512d71
Cover the largest drafter class in the fallback reserve, and stop dou…
danielhanchen Aug 11, 2026
110ae05
Size an unlistable drafter from the cache, and key the CPU exemption …
danielhanchen Aug 11, 2026
0c4e21a
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
7c7d2d4
Narrow the cached drafter by quant, and keep a CPU drafter out of the…
danielhanchen Aug 11, 2026
2d51f68
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
022bd7e
Decide on the placement the loop takes, and read one cached revision
danielhanchen Aug 11, 2026
56b6c38
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
65b3a31
Let an extras draft path and a CPU pin displace the repository sideca…
danielhanchen Aug 11, 2026
4a92688
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
02b2314
Charge nothing for a drafter repo whose every split is incomplete, pe…
danielhanchen Aug 11, 2026
a250913
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 11, 2026
65e08f6
Studio: narrow the drafter VRAM charges and keep the MLA drop reason
danielhanchen Aug 11, 2026
eb7549c
Studio: classify the winning draft flag and check shard indices
danielhanchen Aug 12, 2026
c0d1f53
Studio: scan the Hugging Face cache Studio is pointed at
danielhanchen Aug 12, 2026
40bcaa1
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Aug 12, 2026
0c1cd37
Studio: drop three comment blocks that later rounds made wrong
danielhanchen Aug 12, 2026
8e5302d
Merge commit '0c1cd3753b2125625826ceeab746a4128457d2d9' into pr-8435-…
danielhanchen Aug 12, 2026
49b82bc
Add staging CI workflows for unslothai/unsloth#8435
danielhanchen Aug 12, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
29 changes: 29 additions & 0 deletions .github/workflows/staging-8435-macos-14.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: "staging-8435 macos-14"
on:
push:
branches: ["pr-8435-xplat-ci"]
workflow_dispatch:
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true
permissions:
contents: read
defaults:
run:
shell: bash
jobs:
test:
runs-on: macos-14
timeout-minutes: 30
env:
UNSLOTH_COMPILE_DISABLE: '1'
UNSLOTH_IS_PRESENT: '1'
steps:
- uses: actions/checkout@v4
with:
persist-credentials: false
- uses: actions/setup-python@v5
with:
python-version: '3.12'
- run: python -m pip install -r studio/backend/requirements/studio.txt pytest pytest-asyncio pytest-timeout python-multipart
- run: rc=0; PYTHONPATH=studio/backend python -m pytest studio/backend/tests/test_chat_load_during_training.py studio/backend/tests/test_compute_buffer.py studio/backend/tests/test_llama_cpp_placement.py studio/backend/tests/test_mtp_drafter_companion.py studio/backend/tests/test_mtp_vram_budget.py -q --tb=short -k 'not llama_cpp_load_progress_live and not TestGpuAutoSelection and not TestPreSpawnGpuResolution and not TestPerGpuFitGuardAllCounts and not TestTransformersIntrospection and not test_returns_cuda_when_cuda_available and not test_calls_cuda_cache_when_cuda' > pytest_out.txt 2>&1 || rc=$?; cat pytest_out.txt; if [ "$rc" = "5" ]; then echo "no tests ran (deps absent on this runner)"; rc=0; fi; if [ "$rc" = "2" ] && grep -qE "No module named .(torch|unsloth_zoo)." pytest_out.txt && ! grep -qE "^(FAILED|ERROR) " pytest_out.txt; then echo "collection needs a dep this runner does not ship"; rc=0; fi; exit "$rc"
29 changes: 29 additions & 0 deletions .github/workflows/staging-8435-ubuntu-latest.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: "staging-8435 ubuntu-latest"
on:
push:
branches: ["pr-8435-xplat-ci"]
workflow_dispatch:
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true
permissions:
contents: read
defaults:
run:
shell: bash
jobs:
test:
runs-on: ubuntu-latest
timeout-minutes: 30
env:
UNSLOTH_COMPILE_DISABLE: '1'
UNSLOTH_IS_PRESENT: '1'
steps:
- uses: actions/checkout@v4
with:
persist-credentials: false
- uses: actions/setup-python@v5
with:
python-version: '3.12'
- run: python -m pip install -r studio/backend/requirements/studio.txt pytest pytest-asyncio pytest-timeout python-multipart
- run: rc=0; PYTHONPATH=studio/backend python -m pytest studio/backend/tests/test_chat_load_during_training.py studio/backend/tests/test_compute_buffer.py studio/backend/tests/test_llama_cpp_placement.py studio/backend/tests/test_mtp_drafter_companion.py studio/backend/tests/test_mtp_vram_budget.py -q --tb=short -k 'not llama_cpp_load_progress_live and not TestGpuAutoSelection and not TestPreSpawnGpuResolution and not TestPerGpuFitGuardAllCounts and not TestTransformersIntrospection and not test_returns_cuda_when_cuda_available and not test_calls_cuda_cache_when_cuda' > pytest_out.txt 2>&1 || rc=$?; cat pytest_out.txt; if [ "$rc" = "5" ]; then echo "no tests ran (deps absent on this runner)"; rc=0; fi; if [ "$rc" = "2" ] && grep -qE "No module named .(torch|unsloth_zoo)." pytest_out.txt && ! grep -qE "^(FAILED|ERROR) " pytest_out.txt; then echo "collection needs a dep this runner does not ship"; rc=0; fi; exit "$rc"
29 changes: 29 additions & 0 deletions .github/workflows/staging-8435-windows-latest.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: "staging-8435 windows-latest"
on:
push:
branches: ["pr-8435-xplat-ci"]
workflow_dispatch:
concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true
permissions:
contents: read
defaults:
run:
shell: bash
jobs:
test:
runs-on: windows-latest
timeout-minutes: 30
env:
UNSLOTH_COMPILE_DISABLE: '1'
UNSLOTH_IS_PRESENT: '1'
steps:
- uses: actions/checkout@v4
with:
persist-credentials: false
- uses: actions/setup-python@v5
with:
python-version: '3.12'
- run: python -m pip install -r studio/backend/requirements/studio.txt pytest pytest-asyncio pytest-timeout python-multipart
- run: rc=0; PYTHONPATH=studio/backend python -m pytest studio/backend/tests/test_chat_load_during_training.py studio/backend/tests/test_compute_buffer.py studio/backend/tests/test_llama_cpp_placement.py studio/backend/tests/test_mtp_drafter_companion.py studio/backend/tests/test_mtp_vram_budget.py -q --tb=short -k 'not llama_cpp_load_progress_live and not TestGpuAutoSelection and not TestPreSpawnGpuResolution and not TestPerGpuFitGuardAllCounts and not TestTransformersIntrospection and not test_returns_cuda_when_cuda_available and not test_calls_cuda_cache_when_cuda' > pytest_out.txt 2>&1 || rc=$?; cat pytest_out.txt; if [ "$rc" = "5" ]; then echo "no tests ran (deps absent on this runner)"; rc=0; fi; if [ "$rc" = "2" ] && grep -qE "No module named .(torch|unsloth_zoo)." pytest_out.txt && ! grep -qE "^(FAILED|ERROR) " pytest_out.txt; then echo "collection needs a dep this runner does not ship"; rc=0; fi; exit "$rc"
Loading
Loading