[vllm] feat: Support online quant for rollout with torchao#3084

wuxibin89 merged 1 commit intoverl-project:mainverl-project/verl:mainfrom

jerryzh168:on-the-fly-quantjerryzh168/verl:on-the-fly-quantCopy head branch name to clipboard