Skip to content

QVAC-18873 feat[api|mod]: expose diffusion_fa, drop flux_flow, sync model registry #2046

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
gianni-cor merged 13 commits into from
May 20, 2026
Merged

QVAC-18873 feat[api|mod]: expose diffusion_fa, drop flux_flow, sync model registry #2046

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
0e84f56
feat(sdk): expose diffusion_fa in sdcppConfigSchema
donriddo May 14, 2026
628d6d2
fix(sdk): remove flux_flow from prediction enum
donriddo May 14, 2026
220fc2c
fix(sdk): simplify diffusion_fa description and add unit test coverage
donriddo May 14, 2026
a5659f6
test(sdk): add diffusion_fa E2E test to tests-qvac
donriddo May 15, 2026
b925dbb
test(sdk): remove misleading comment from diffusion-fa resource
donriddo May 15, 2026
a2b4feb
test(sdk): add rejection tests for flux_flow and diffusion_fa type; f…
donriddo May 15, 2026
4acf3c0
feat[mod](sdk): add Gemma4-E2B/E4B/31B, Qwen3.5-0.8B/2B/4B/9B, Qwen3.…
donriddo May 17, 2026
95bd5a7
fix[notask]: bump @qvac/diffusion-cpp to ^0.8.0
donriddo May 18, 2026
444dc01
test(sdk): prove diffusion_fa:false override path end-to-end
donriddo May 19, 2026
f9e160e
Merge branch 'main' into feat/sdk-expose-diffusion-fa
gianni-cor May 19, 2026
d20c9d1
fix(sdk): replace hardcoded HF URLs with registry constants; add qwen…
donriddo May 20, 2026
641e7f4
Merge branch 'main' into feat/sdk-expose-diffusion-fa
gianni-cor May 20, 2026
ee1874a
Merge branch 'main' into feat/sdk-expose-diffusion-fa
gianni-cor May 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 2 additions & 6 deletions packages/sdk/examples/tools/llamacpp-tools-gemma4.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,16 +19,12 @@ import {
completion,
loadModel,
unloadModel,
GEMMA4_2B_MULTIMODAL_Q4_K_M,
type ToolCall,
} from "@qvac/sdk";
import { tools, mockExecute } from "./shared";

// bartowski's pack tags <eos> as the EOG token (matching the base tokenizer),
// ensuring generation stops correctly; unsloth's variant maps it differently.
const GEMMA4_HF =
"https://huggingface.co/bartowski/google_gemma-4-E2B-it-GGUF/resolve/main/google_gemma-4-E2B-it-Q4_K_M.gguf";

const modelSrc = process.argv[2] ?? GEMMA4_HF;
const modelSrc = process.argv[2] ?? GEMMA4_2B_MULTIMODAL_Q4_K_M;

let modelId: string | undefined;
try {
Expand Down
6 changes: 2 additions & 4 deletions packages/sdk/examples/tools/llamacpp-tools-qwen35.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,14 +15,12 @@ import {
completion,
loadModel,
unloadModel,
QWEN3_5_0_8B_MULTIMODAL_Q8_0,
type ToolCall,
} from "@qvac/sdk";
import { tools, mockExecute } from "./shared";

const QWEN35_HF =
"https://huggingface.co/unsloth/Qwen3.5-0.8B-GGUF/resolve/main/Qwen3.5-0.8B-Q8_0.gguf";

const modelSrc = process.argv[2] ?? QWEN35_HF;
const modelSrc = process.argv[2] ?? QWEN3_5_0_8B_MULTIMODAL_Q8_0;

let modelId: string | undefined;
try {
Expand Down
110 changes: 110 additions & 0 deletions packages/sdk/models/history/0e91a173a.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,110 @@
commit=0e91a173a8a0040803f5902164fb9b484a08b079
timestamp=2026-05-17T09:39:08.281Z
previous_count=624
new_count=709

[added]
GEMMA4_31B_MULTIMODAL_Q4_K_M
GEMMA4_31B_MULTIMODAL_Q6_K
MMPROJ_GEMMA4_31B_MULTIMODAL_BF16
MMPROJ_GEMMA4_31B_MULTIMODAL_F16
GEMMA4_2B_MULTIMODAL_Q4_K_M
GEMMA4_2B_MULTIMODAL_Q6_K
MMPROJ_GEMMA4_2B_MULTIMODAL_BF16
MMPROJ_GEMMA4_2B_MULTIMODAL_F16
GEMMA4_4B_MULTIMODAL_Q4_K_M
GEMMA4_4B_MULTIMODAL_Q6_K
MMPROJ_GEMMA4_4B_MULTIMODAL_BF16
MMPROJ_GEMMA4_4B_MULTIMODAL_F16
BERGAMOT_METADATA
BERGAMOT_EN_BS_LEX
BERGAMOT_METADATA_1
BERGAMOT_EN_BS
BERGAMOT_EN_BS_VOCAB
BERGAMOT_METADATA_2
BERGAMOT_EN_NB_LEX
BERGAMOT_METADATA_3
BERGAMOT_EN_NB
BERGAMOT_EN_NB_VOCAB
BERGAMOT_METADATA_4
BERGAMOT_EN_NO_LEX
BERGAMOT_METADATA_5
BERGAMOT_EN_NO
BERGAMOT_EN_NO_VOCAB
BERGAMOT_EN_SR_LEX
BERGAMOT_METADATA_6
BERGAMOT_EN_SR
BERGAMOT_EN_SR_VOCAB
BERGAMOT_EN_TH_LEX
BERGAMOT_METADATA_7
BERGAMOT_EN_TH
BERGAMOT_EN_TH_VOCAB
BERGAMOT_EN_VI_LEX
BERGAMOT_METADATA_8
BERGAMOT_EN_VI
BERGAMOT_EN_VI_VOCAB
BERGAMOT_EN_ZH_LEX
BERGAMOT_METADATA_9
BERGAMOT_EN_ZH
BERGAMOT_EN_ZH_SRCVOCAB
BERGAMOT_EN_ZH_TRGVOCAB
BERGAMOT_LEX
BERGAMOT_METADATA_10
BERGAMOT
BERGAMOT_VOCAB
BERGAMOT_NO_EN_LEX
BERGAMOT_METADATA_11
BERGAMOT_NO_EN
BERGAMOT_NO_EN_VOCAB
BERGAMOT_TH_EN_LEX
BERGAMOT_METADATA_12
BERGAMOT_TH_EN
BERGAMOT_TH_EN_VOCAB
BERGAMOT_ZH_EN_LEX
BERGAMOT_ZH_EN
BERGAMOT_ZH_EN_VOCAB
PARAKEET_TDT_PARAKEET_CTC_0_6B_Q8_0_Q8_0
PARAKEET_TDT_PARAKEET_EOU_120M_V1_Q8_0_Q8_0
PARAKEET_TDT_PARAKEET_TDT_0_6B_V3_Q8_0_Q8_0
PARAKEET_TDT_Q8_0
QWEN3_5_0_8B_MULTIMODAL_Q4_K_M
QWEN3_5_0_8B_MULTIMODAL_Q8_0
MMPROJ_QWEN3_5_0_8B_MULTIMODAL_BF16
MMPROJ_QWEN3_5_0_8B_MULTIMODAL_F16
QWEN3_5_2B_MULTIMODAL_Q4_K_M
QWEN3_5_2B_MULTIMODAL_Q6_K
MMPROJ_QWEN3_5_2B_MULTIMODAL_BF16
MMPROJ_QWEN3_5_2B_MULTIMODAL_F16
QWEN3_5_4B_MULTIMODAL_Q4_K_M
QWEN3_5_4B_MULTIMODAL_Q6_K
MMPROJ_QWEN3_5_4B_MULTIMODAL_BF16
MMPROJ_QWEN3_5_4B_MULTIMODAL_F16
QWEN3_5_9B_MULTIMODAL_Q4_K_M
QWEN3_5_9B_MULTIMODAL_Q6_K
MMPROJ_QWEN3_5_9B_MULTIMODAL_BF16
MMPROJ_QWEN3_5_9B_MULTIMODAL_F16
QWEN3_6_27B_MULTIMODAL_Q4_K_XL
QWEN3_6_27B_MULTIMODAL_Q6_K_XL
MMPROJ_QWEN3_6_27B_MULTIMODAL_BF16
MMPROJ_QWEN3_6_27B_MULTIMODAL_F16
QWEN3_6_35B_A3B_MULTIMODAL_Q4_K_M
QWEN3_6_35B_A3B_MULTIMODAL_Q6_K_XL
MMPROJ_QWEN3_6_35B_A3B_MULTIMODAL_BF16
MMPROJ_QWEN3_6_35B_A3B_MULTIMODAL_F16

[updated]
BERGAMOT_EN_BG_LEX
BERGAMOT_EN_BG
BERGAMOT_EN_BG_VOCAB
BERGAMOT_EN_HR_LEX
BERGAMOT_EN_HR
BERGAMOT_EN_HR_VOCAB
BERGAMOT_EN_NL_LEX
BERGAMOT_EN_NL
BERGAMOT_EN_NL_VOCAB
BERGAMOT_METADATA_13

[removed]
BERGAMOT_METADATA_28
BERGAMOT_METADATA_40

Loading
Loading