[Frontend] Optionally remove memory buffer used for uploading to URLs in run_batch#12927

DarkLight1337 merged 4 commits into

vllm-project:mainvllm-project/vllm:mainfrom

pooyadavoodi:improve_batch_write_file_with_retrypooyadavoodi/vllm:improve_batch_write_file_with_retryCopy head branch name to clipboard