nick's streaming changes#1

joshuadeng wants to merge 5 commits intojoshuadeng:streaming_supportjoshuadeng/vllm:streaming_supportfrom

njhill:streaming_support_nick1njhill/vllm:streaming_support_nick1Copy head branch name to clipboard