Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Safe LayerNorm #15002

Merged
merged 3 commits into from
May 22, 2019
Merged

Safe LayerNorm #15002

merged 3 commits into from
May 22, 2019

Commits on May 21, 2019

  1. use float32 to store the reduction result of float16 

    enable safe accumulation

fix bug

fix
    @sxjscience
    sxjscience committed May 21, 2019
    Configuration menu
    Copy the full SHA
    53f31e1 View commit details
    Browse the repository at this point in the history

  2. update test for safe_accumulate

    @sxjscience
    sxjscience committed May 21, 2019
    Configuration menu
    Copy the full SHA
    cd73c73 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2019

  1. fix

    @sxjscience
    sxjscience committed May 22, 2019
    Configuration menu
    Copy the full SHA
    cd12363 View commit details
    Browse the repository at this point in the history