perf: batch draft traversal and compact grammar caches - #1

Closed

benmyles wants to merge 3 commits into

mainfrom

agent/batched-grammar-performance

Commits on Jul 27, 2026

perf: batch draft traversal and compact grammar caches
benmyles
committed
3a493ea
fix: honor DLTensor byte offsets in bitmask writes
benmyles
committed
a332f5b
fix: propagate batch worker exceptions
benmyles
committed
91db6bf