This repository was archived by the owner on Jun 3, 2025. It is now read-only.

[Continuous Batching] Executor thread for running continuous batching#1374

Merged

bfineran merged 3 commits intov2from

continuous-batching-executor

Nov 13, 2023

Commits on Nov 13, 2023

[Continuous Batching] Executor thread for running continuous batching
Benjamin
committed
quality
Benjamin
committed
ensure that executor stops when main thread does - clean up test hack
Benjamin
committed