Skip to content

[feat] support dspark (Nanbeige4.2-3B) - #27730

Merged
ggerganov merged 1 commit into
ggml-org:masterfrom
Nanbeige:nbg42
Aug 27, 2026
Merged

[feat] support dspark (Nanbeige4.2-3B)#27730
ggerganov merged 1 commit into
ggml-org:masterfrom
Nanbeige:nbg42

Conversation

@zqlcode

@zqlcode zqlcode commented Aug 26, 2026

Copy link
Copy Markdown
Contributor

Overview

Nanbeige4.2 support dspark

Additional information

test

./build/bin/llama-cli \
  -m /Users/admin/Documents/model/nanbeige4.2_3b_preview_0715-Q4_K_M.gguf \
  -md /Users/admin/Documents/model/r19-step8000/nanbeige4.2-3B-DSpark-Q4_K_M.gguf \
  --spec-type draft-dspark \
  --spec-draft-n-max 3 \
  -ngl 99 \
  -ngld 99 \
  -c 4096 \
  -p "Find the sum of all positive integers \$n$ such that \$n + 2$ divides the product 3(\$n + 3)(\$n^2 + 9)."

no dspark
image

enable dspark
image

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: YES - used AI assistance for implementation help and review. I reviewed every changed line, tested locally, and take full responsibility for this PR.

@zqlcode
zqlcode requested a review from CISC as a code owner August 26, 2026 09:57
@github-actions github-actions Bot added the model Model specific label Aug 26, 2026

@CISC CISC left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm guessing it will be DSparkDraftModel arch so no conversion challenges?

@CISC CISC added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Aug 26, 2026
@ggerganov
ggerganov merged commit d7a2074 into ggml-org:master Aug 27, 2026
25 of 27 checks passed
@KotPrezesOfficial

Copy link
Copy Markdown

3b model and only 21 tok/sec ?! What did you test it on ?

ppenatra pushed a commit to ppenatra/llama.cpp that referenced this pull request Aug 27, 2026
Co-authored-by: admin <lizongqiang@kanzhun.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. model Model specific

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants