Skip to content

Falcon H1 training is fp16 is unstable with the mamba kernels. NaN's

4189d46
Select commit
Loading
Failed to load commit list.
Merged

Falcon H1 dtype float16 update #212

Falcon H1 training is fp16 is unstable with the mamba kernels. NaN's
4189d46
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs