[AutoRound] Add offline quantized W4A16 model support#1777

lishunyang12 merged 18 commits into

vllm-project:mainvllm-project/vllm-omni:mainfrom

yiliu30:feats/ar-w4a16yiliu30/vllm-omni-fork:feats/ar-w4a16Copy head branch name to clipboard