Granite-Switch Architecture - #25107

Merged

CISC merged 48 commits into

ggml-org:masterfrom

barvhaim:feature/granite-switch

Aug 10, 2026

Commits on Jul 26, 2026

granite-switch: add llama.cpp backend (POC, CPU)
barvhaim
committed
d957225
granite-switch: add Mac (Metal) build + mid-sequence switch demo script
barvhaim
committed
6e734e8
granite-switch mac demo: add -no-cnv so each run is one-shot
barvhaim
committed
af48dfa
granite-switch: replace global sticky index with in-graph router attention
barvhaim
committed
16c9ad5
granite-switch: drop scratch tests and mac demo for upstream PR
barvhaim
committed
30ffe08
granite-switch: trim comments to match native llama.cpp style
barvhaim
committed
0ac7c96
granite-switch: trim conversion comments to match native style
barvhaim
committed
b17c0bc
granite-switch: drop unused adapter_ranks metadata
barvhaim
committed
7626399
granite-switch: rename arch to graniteswitch and drop obid alias
barvhaim
committed
e193ea5
granite-switch: fix non-ASCII comments and document router gain assumption
barvhaim
committed
2b179f0
granite-switch: drop section comments from constants.py to match native style
barvhaim
committed
3041ba8
granite-switch: add functional tensor block comments matching Granite4 Vision style
barvhaim
committed
8c35307
granite-switch: clarify n_expert_used comment
barvhaim
committed
36936ad
granite-switch: note n_layer_nextn reuse has no MTP
barvhaim
committed
dba81e3
granite-switch: rename source file and apply review nits
barvhaim
committed
26f2843
granite-switch: don't force LoRA tensors to F16, follow --outtype instead
barvhaim
committed
116c611
granite-switch: drop redundant _permute_qk wrapper, call LlamaModel.permute directly
barvhaim
committed
6be5d0c
granite-switch: read router gain from GGUF (control_token_gain) instead of hardcoding 15.0
barvhaim
committed
059401c
granite-switch: derive n_slots()
barvhaim
committed
8d71a5c
granite-switch: move llm_graph_input_switch into granite-switch.cpp
barvhaim
committed
afa1b7e
granite-switch: cut AI-style narration comments
barvhaim
committed
5b2cb93
granite-switch: collapse multi-line comments
barvhaim
committed
d385fc2
granite-switch: rename control_token_* maps to adapter_token_*
barvhaim
committed
768e608
granite-switch: cut noise comments
barvhaim
committed
03e46c1
granite-switch: rename embedded LoRA tensors to <base>.lora_a/lora_b
barvhaim
committed
24e06e9
granite-switch: GGML_ASSERT token input to avoid UB on embeddings
barvhaim
committed
613bc19
granite-switch: TODO for raw embedding input support
barvhaim
committed
472d1c9
granite-switch: collapse LoRA tensor constants to .lora_a/.lora_b suffix
barvhaim
committed
c601484
granite-switch: drop n_expert_used hack, guard mul_mat_id buft probe
barvhaim
committed
622eb21
granite-switch: stop forcing dense expert counts, read from config
barvhaim
committed
ad04ce8
granite-switch: renamed control_token_gain metadata key to router_gain
barvhaim
committed
1d15ea3
granite-switch: trim header comments to match native style
barvhaim
committed
e99c056
granite-switch: collapse LoRA tensors to base name + suffix
barvhaim
committed
46d882e
granite-switch: inline suffix checks in tensor op resolution
barvhaim
committed
d99296f
granite-switch: drop switch-lora struct comment
barvhaim
committed
c57b00f
granite-switch: guard router layer index and inline n_slots
barvhaim
committed
d2ca90b
granite-switch: group adapter metadata under {arch}.adapters.* namespace
barvhaim
committed
11890d3
granite-switch: add hparams.has_rope(il) for KV-shift rope skipping
barvhaim
committed
ae2ae69
granite-switch: skip arch in test-llama-archs (adapter fixture missing, TODO)
barvhaim
committed
d886073
granite-switch: Keys.Adapters namespace + simplify n_slots
barvhaim
committed
2204806
granite-switch: validate substitute token ids against n_vocab
barvhaim
committed
5669857
granite-switch: bound adapter count and lora rank from GGUF
barvhaim
committed
a7271ce
granite-switch: reject MTP context type when router_layer is set
barvhaim
committed
64278bb
granite-switch: throw on bad adapter metadata instead of GGML_ASSERT
barvhaim
committed
34f5607
granite-switch: use ASCII +/- in router K signal comment
barvhaim
committed
7cc8ba1
granite-switch: document n_layer_nextn repurpose and its leak points
barvhaim
committed
118cf8a
granite-switch: gate lora_a/lora_b op mapping on router_layer
barvhaim
committed
65cb201
granite-switch: label all three preview model sizes
barvhaim
committed
15e473d