FP8: Load model on-the-fly in vLLM#380

danielhanchen merged 1 commit into

unslothai:mainunslothai/unsloth-zoo:mainfrom

andrewor14:true-on-the-fly-fp8andrewor14/unsloth-zoo:true-on-the-fly-fp8Copy head branch name to clipboard