Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Multi-precision AdamW update op #14171

Merged
merged 8 commits into from
Feb 20, 2019
Merged

Multi-precision AdamW update op #14171

merged 8 commits into from
Feb 20, 2019

Commits on Feb 9, 2019

  1. mp adamw update

    Ubuntu committed Feb 9, 2019
    Configuration menu
    Copy the full SHA
    bc07cfd View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2019

  1. Softmax fp16 (#201) 

    * softmax for fp16 with fp32 accumulator

* return AType in kernel

* add dtype

* kernel
    @eric-haibin-lin
    eric-haibin-lin authored and Ubuntu committed Feb 12, 2019
    Configuration menu
    Copy the full SHA
    5869e0a View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2019

  1. adamw with nan check

    Ubuntu committed Feb 14, 2019
    Configuration menu
    Copy the full SHA
    c44220a View commit details
    Browse the repository at this point in the history

  2. add doc

    Ubuntu committed Feb 14, 2019
    Configuration menu
    Copy the full SHA
    0c940ff View commit details
    Browse the repository at this point in the history

  3. Revert "Softmax fp16 (#201)" 

    This reverts commit 5869e0a.
    Ubuntu committed Feb 14, 2019
    Configuration menu
    Copy the full SHA
    c9fdbaf View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2019

  1. add test

    Ubuntu committed Feb 16, 2019
    Configuration menu
    Copy the full SHA
    6ac647f View commit details
    Browse the repository at this point in the history

Commits on Feb 17, 2019

  1. more test for fp16

    Ubuntu committed Feb 17, 2019
    Configuration menu
    Copy the full SHA
    0a62435 View commit details
    Browse the repository at this point in the history

Commits on Feb 18, 2019

  1. skip update for rescale = 0

    Ubuntu committed Feb 18, 2019
    Configuration menu
    Copy the full SHA
    bd39153 View commit details
    Browse the repository at this point in the history