Skip to content
This repository has been archived by the owner on Jan 15, 2024. It is now read-only.

Enable bias correction in AdamW when fine-tuning BERT #1468

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Enable bias correction in AdamW when fine-tuning BERT #1468

wants to merge 1 commit into from

Commits on Jan 7, 2021

  1. Enable bias correction in AdamW when fine-tuning BERT 

    Mosbach, Marius, Maksym Andriushchenko, and Dietrich Klakow. "On the Stability of Fine-tuning BERT: Misconceptions, Explanations, and Strong Baselines." arXiv preprint arXiv:2006.04884 (2020).

Zhang, Tianyi, et al. "Revisiting Few-sample BERT Fine-tuning." arXiv preprint arXiv:2006.05987 (2020).
    @leezu
    leezu committed Jan 7, 2021
    Configuration menu
    Copy the full SHA
    52ce2a4 View commit details
    Browse the repository at this point in the history