Skip to content

perf(loss): defer the fp32 upcast in the distillation top-k path - #3496

Open
tianyi-zhang-02 wants to merge 16 commits into
NVIDIA-NeMo:mainfrom
tianyi-zhang-02:perf/distill-topk-defer-fp32-upcast
Open

perf(loss): defer the fp32 upcast in the distillation top-k path#3496
tianyi-zhang-02 wants to merge 16 commits into
NVIDIA-NeMo:mainfrom
tianyi-zhang-02:perf/distill-topk-defer-fp32-upcast