Code

nan detection and intervention #1097

Code

Merged

williamFalcon merged 24 commits intoLightning-AI:masterLightning-AI/pytorch-lightning:masterfrom awaelchli:nan_detectionCopy head branch name to clipboardMar 19, 2020

+110-16

Commits

Commits on Mar 7, 2020

• check for nan values

  

  Adrian Wälchli

  committed
  b3c1902

Commits on Mar 8, 2020

• test nan detection on loss

  

  Adrian Wälchli

  committed
  a0a2417

• sys.exit

  

  Adrian Wälchli

  committed
  b690eab

• whitespace

  

  Adrian Wälchli

  committed
  bf75bbe

• detect nan and inf values in loss and params

  

  Adrian Wälchli

  committed
  aa59da0

• update

  

  Adrian Wälchli

  committed
  200c3b1

Commits on Mar 9, 2020

• added documentation

  

  Adrian Wälchli

  committed
  7e1307a

Commits on Mar 11, 2020

• Merge branch 'master' into nan_detection

  

  Adrian Wälchli

  committed
  69ee580

Commits on Mar 17, 2020

• moved detect nan to training loop, remove flag for print

  

  Adrian Wälchli

  committed
  fd31e7b

• blank line

  

  Adrian Wälchli

  committed
  a54be1f

• test

  

  Adrian Wälchli

  committed
  f8a7aa0

• rename

  

  Adrian Wälchli

  committed
  3aa478a

Commits on Mar 18, 2020

• deprecate print_nan_grads

  

  Adrian Wälchli

  committed
  c36e505

• deprecated print_nan_grads

  

  Adrian Wälchli

  committed
  08b1a09

• Merge branch 'master' into nan_detection

  

  Adrian Wälchli

  committed
  62ecaa2

• remove unused imports

  

  Adrian Wälchli

  committed
  8a6b3f3

• update changelog

  

  Adrian Wälchli

  committed
  cb6c7b3

• fix line too long

  

  Adrian Wälchli

  committed
  701a089

• correct deprecated version

  Show description for 68f1007
  

  Adrian Wälchli

  and

  Borda

  authored
  68f1007

• raise exception instead of sysexit

  Show description for 506803a
  

  Adrian Wälchli

  and

  Borda

  authored
  506803a

• raise exception instead of sysexit

  Show description for 0412daa
  

  Adrian Wälchli

  and

  Borda

  authored
  0412daa

• Update pytorch_lightning/trainer/training_tricks.py

  Show description for 893d7dd
  

  Adrian Wälchli

  and

  Borda

  authored
  893d7dd

• Update pytorch_lightning/trainer/training_tricks.py

  Show description for 0d9654f
  

  Adrian Wälchli

  and

  Borda

  authored
  0d9654f

• fix test

  

  Adrian Wälchli

  committed
  6b21d11