mla: add inline per-token outer scales to 368-byte NVFP4 records - #86

mla: add inline per-token outer scales to 368-byte NVFP4 records#86

lukealonso merged 3 commits into

local-inference-lab:masterlocal-inference-lab/b12x:masterfrom

yatesdr:nvfp4-dynamic-token-scaleyatesdr/b12x:nvfp4-dynamic-token-scaleCopy head branch name to clipboard