feat: add inference multi-turn chat interface#3723

Merged

NanoCode012 merged 11 commits into

mainfrom

feat/inference-chat

Jun 16, 2026

Commits on Jun 11, 2026

feat: add interactive multi-turn chat mode (--chat) to inference CLI
NanoCode012
committed
fix: apply_chat_template returns BatchEncoding in transformers v5
NanoCode012
committed
docs: document interactive chat mode for inference
NanoCode012
committed
feat: diffusion turn generation for chat mode; fix fp8 probe on CPU-only torch
NanoCode012
committed
feat: suggest command aliases on typo; save chat sessions in multimodal parts format
NanoCode012
committed
feat: collapse thinking blocks in chat with /expand, /think template toggle, thinking token stats
NanoCode012
committed
fix: suppress unauthenticated HF Hub nag warning in logging config
NanoCode012
committed

Commits on Jun 12, 2026

Commits on Jun 15, 2026

fix: interrupt cache race condition and parse edge case
NanoCode012
committed