DeepSeek-V4-Flash-2bit-DQ on M4 Max: OOM fix, native tool calling, benchmarks, degeneration study - #2

Merged

snagnever merged 23 commits into

mainfrom

deepseek-v4-tool-dsml

May 31, 2026

Commits on May 30, 2026

fix(deepseek-v4): bound Metal residency to stop decode-time OOM + full writeup

snagnever
and
claude
committed
4fdc057

Commits on May 31, 2026

docs(deepseek-v4): record upstream submission + add 300-req knowledge-bench soak

snagnever
and
claude
committed
e117938
docs(deepseek-v4): record knowledge-bench results + ordered remaining-benches plan

snagnever
and
claude
committed
fbfb325
docs(deepseek-v4): queue progress — Veerman done (2/12, tool template N/A)

snagnever
and
claude
committed
1d98c7f
feat(deepseek-v4): tool-aware chat template to enable tool calling

snagnever
and
claude
committed
f3ed584
docs(deepseek-v4): queue progress — DROP done (71%); bump submodule

snagnever
and
claude
committed
03a0853
fix(deepseek-v4): custom deepseek_json tool parser — tool calls now parse (0/4 -> 4/4)

snagnever
and
claude
committed
c10155e
docs(deepseek-v4): tool-calling results (jdhodges 82%, veerman 50%) + multi-tool tweak reverted

snagnever
and
claude
committed
f382151
docs(deepseek-v4): MATH 47% done; bump submodule (MATH/DROP/tool-template notes)

snagnever
and
claude
committed
bd8d423
docs(deepseek-v4): LiveCodeBench 6% done — knowledge sweep complete

snagnever
and
claude
committed
d455eb9
docs(mlx-lm): upstream contribution writeup — tool-call marker token-merge bug

snagnever
and
claude
committed
d2e5e97
docs(mlx-lm): writeup — streaming verified safe (full segment accumulated before parse)

snagnever
and
claude
committed
ee42a41
docs(mlx-lm): record json_tools fix submission (issue #1335, PR #1336)

snagnever
and
claude
committed
5172c0c
docs(deepseek-v4): paste-ready HF comment for PR #16 (tool-template findings)

snagnever
and
claude
committed
b8294ad
chore(deepseek-v4): track remaining-bench queue drivers + bump submodule (tool run data)

snagnever
and
claude
committed
daa0e96
chore: bump submodule (remaining tool-run data)

snagnever
and
claude
committed
2ff7ba7
feat(deepseek-v4): native DSML tool stack — parallel calls work (was the Hermes ceiling)

snagnever
and
claude
committed
e8fafa4
docs(deepseek-v4): native DSML 98%/75% — correct the 2-bit-ceiling conclusion; bump submodule

snagnever
and
claude
committed
0715581
docs(deepseek-v4): record deepseek_dsml parser PR submission (mlx-lm #1337)

snagnever
and
claude
committed
b8793ca
docs: DSML-enriched HF #16 comment (98%/75% native, parser PR #1337)

snagnever
and
claude
committed
5b6e0c3
docs: paste-ready HF post for mlx-community DeepSeek-V4-Flash#1 (OOM fix + looping = quant)

snagnever
and
claude
committed
594f609
docs: HF leak post — add explicit KeyError fix + the #45643 error chain

snagnever
and
claude
committed
b4528b9
degeneration sampling study: rate-measured, no setting fixes the 2-bit loop

snagnever
and
claude
committed
21b5905

Navigation Menu

DeepSeek-V4-Flash-2bit-DQ on M4 Max: OOM fix, native tool calling, benchmarks, degeneration study - #2

DeepSeek-V4-Flash-2bit-DQ on M4 Max: OOM fix, native tool calling, benchmarks, degeneration study#2
snagnever merged 23 commits into
mainfrom
deepseek-v4-tool-dsml

Commits on May 30, 2026

fix(deepseek-v4): bound Metal residency to stop decode-time OOM + full writeup

Commits on May 31, 2026

docs(deepseek-v4): record upstream submission + add 300-req knowledge-bench soak

docs(deepseek-v4): record knowledge-bench results + ordered remaining-benches plan

docs(deepseek-v4): queue progress — Veerman done (2/12, tool template N/A)

feat(deepseek-v4): tool-aware chat template to enable tool calling

docs(deepseek-v4): queue progress — DROP done (71%); bump submodule

fix(deepseek-v4): custom deepseek_json tool parser — tool calls now parse (0/4 -> 4/4)

docs(deepseek-v4): tool-calling results (jdhodges 82%, veerman 50%) + multi-tool tweak reverted

docs(deepseek-v4): MATH 47% done; bump submodule (MATH/DROP/tool-template notes)

docs(deepseek-v4): LiveCodeBench 6% done — knowledge sweep complete

docs(mlx-lm): upstream contribution writeup — tool-call marker token-merge bug

docs(mlx-lm): writeup — streaming verified safe (full segment accumulated before parse)

docs(mlx-lm): record json_tools fix submission (issue #1335, PR #1336)

docs(deepseek-v4): paste-ready HF comment for PR #16 (tool-template findings)

chore(deepseek-v4): track remaining-bench queue drivers + bump submodule (tool run data)

chore: bump submodule (remaining tool-run data)

feat(deepseek-v4): native DSML tool stack — parallel calls work (was the Hermes ceiling)

docs(deepseek-v4): native DSML 98%/75% — correct the 2-bit-ceiling conclusion; bump submodule

docs(deepseek-v4): record deepseek_dsml parser PR submission (mlx-lm #1337)

docs: DSML-enriched HF #16 comment (98%/75% native, parser PR #1337)

docs: paste-ready HF post for mlx-community DeepSeek-V4-Flash#1 (OOM fix + looping = quant)

docs: HF leak post — add explicit KeyError fix + the #45643 error chain

degeneration sampling study: rate-measured, no setting fixes the 2-bit loop