25% less mem and 10% faster training: Do not upcast lm_head and embedding to float32#1186

danielhanchen merged 2 commits intounslothai:nightlyunslothai/unsloth:nightlyfrom

Datta0:lm_head_no_upcastDatta0/unsloth:lm_head_no_upcastCopy head branch name to clipboard