Skip to content

server: allow accessing /metrics and /slots during llama_decode() - #27041

Merged
ngxson merged 6 commits into
masterfrom
xsn/non_blocking_metrics
Aug 14, 2026
Merged

server: allow accessing /metrics and /slots during llama_decode()#27041
ngxson merged 6 commits into
masterfrom
xsn/non_blocking_metrics