[Online Quantization] Support memory-efficient online quantization via layerwise loading#34184

kylesayrs wants to merge 2 commits intovllm-project:mainvllm-project/vllm:mainfrom

neuralmagic:kylesayrs/layerwise-loading-online-quantneuralmagic/vllm:kylesayrs/layerwise-loading-online-quantCopy head branch name to clipboard