Allow continuous batching to be disabled#6358
Open
ibehnam wants to merge 4 commits intoggml-org:masterfrom
Open
Allow continuous batching to be disabled#6358ibehnam wants to merge 4 commits intoggml-org:masterfrom
ibehnam wants to merge 4 commits intoggml-org:masterfrom