merge: sync upstream + 14-model benchmark (v0.2.7 → v0.3.x)#67

Merged

raullenchai merged 69 commits intomainfrom

feat/upstream-sync-pr-a

Apr 6, 2026

Commits on Feb 24, 2026

fix: Use streaming detokenizer for UTF-8-safe incremental decode

janhilgard
and
claude
committed

Commits on Feb 28, 2026

Add --served-model-name CLI parameter
otarkhan
committed
Fix prefix cache dir using served name instead of model path
otarkhan
committed
Add Qwen3.5 model support with text-only loading and fix reasoning+tool streaming

otarkhan
and
claude
committed

Commits on Mar 11, 2026

fix: check trim method existence before calling
OpenClaw
committed

Commits on Mar 12, 2026

Commits on Mar 14, 2026

fix: pass size to ArraysCache in BatchMambaCache for Qwen3.5 hybrid models
neomody77
committed

Commits on Mar 20, 2026

Commits on Mar 21, 2026

Commits on Mar 22, 2026

Commits on Mar 25, 2026

fix: bump mlx-lm minimum to 0.31.0 for hybrid model batching
krystophny
committed

Commits on Mar 26, 2026

merge: sync upstream origin/main — SpecPrefill, native video, MTP injection, served-model-name

Your Name
and
claude
committed
fix: alias validation, Hub model MTP routing, non-streaming text path, use_cache double-pop

Your Name
and
claude
committed
fix: non-streaming text-only MTP deadlock and accumulation bug

Your Name
and
claude
committed
fix: forward stop sequences to text-only MTP generation path

Your Name
and
claude
committed
fix: truncate new_text on stop hit so SSE streams omit stop sequence

Your Name
and
claude
committed

Commits on Mar 27, 2026

fix: use self.max_kv_size instead of None in _make_cache call

Brett Thompson
authored and
Brett Thompson
committed

Commits on Mar 30, 2026

fix: report prompt_tokens correctly for LLM models in SimpleEngine

sjswerdloff
and
clement-7074f29f
committed

Commits on Mar 31, 2026

Commits on Apr 1, 2026

Merge pull request #232 from sjswerdloff/fix/streaming-tool-call-content-leak
Thump604
authored

Commits on Apr 3, 2026

merge: sync upstream origin/main — streaming filters, Anthropic think blocks, detokenizer, v0.2.7

Your Name
and
claude
committed
fix: missing return in load_model_with_fallback success path

Your Name
and
claude
committed
bench: re-run benchmarks post-merge on 4 models

Your Name
and
claude
committed
bench: comprehensive 14-model benchmark + agent integration tests

Your Name
and
claude
committed