Code

Olmo tiny scripts#628

Code

Merged

ananyahjha93 merged 46 commits intomainallenai/OLMo:mainfrom olmo-tinyallenai/OLMo:olmo-tinyCopy head branch name to clipboardJun 28, 2024

+5,201-59

Commits

Commits on Jun 18, 2024

• olmo tiny with ddp configs

  ananyahjha93

  committed
  f530361

  Copy full SHA for f530361

• .

  ananyahjha93

  committed
  2fa2551

  Copy full SHA for 2fa2551

• final scripts for OLMo tiny

  ananyahjha93

  committed
  62968ca

  Copy full SHA for 62968ca

• final scripts for OLMo tiny

  ananyahjha93

  committed
  3a3c64f

  Copy full SHA for 3a3c64f

Commits on Jun 19, 2024

• updated config based on comments

  ananyahjha93

  committed
  6f766da

  Copy full SHA for 6f766da

• updated config based on comments

  ananyahjha93

  committed
  18a9592

  Copy full SHA for 18a9592

• updated config based on comments

  ananyahjha93

  committed
  c3483f0

  Copy full SHA for c3483f0

• updated config based on comments

  ananyahjha93

  committed
  fd32714

  Copy full SHA for fd32714

• updated config based on comments

  ananyahjha93

  committed
  d4d39c1

  Copy full SHA for d4d39c1

• updated config based on comments

  ananyahjha93

  committed
  c5c8100

  Copy full SHA for c5c8100

• .

  ananyahjha93

  committed
  76ce0f8

  Copy full SHA for 76ce0f8

• .

  ananyahjha93

  committed
  2d07c10

  Copy full SHA for 2d07c10

• script

  ananyahjha93

  committed
  564902c

  Copy full SHA for 564902c

• script

  ananyahjha93

  committed
  aec289b

  Copy full SHA for aec289b

• .

  ananyahjha93

  committed
  5d225f4

  Copy full SHA for 5d225f4

• .

  ananyahjha93

  committed
  7d0e4f5

  Copy full SHA for 7d0e4f5

• .

  ananyahjha93

  committed
  cac1430

  Copy full SHA for cac1430

• fix n_layers in 300M

  ananyahjha93

  committed
  4f4bc74

  Copy full SHA for 4f4bc74

Commits on Jun 20, 2024

• grad norm 2, 20M

  ananyahjha93

  committed
  a0f4663

  Copy full SHA for a0f4663

Commits on Jun 24, 2024

• added new config for tiny runs

  ananyahjha93

  committed
  e51c0a9

  Copy full SHA for e51c0a9

• added FLOPs logging

  ananyahjha93

  committed
  89f588a

  Copy full SHA for 89f588a

• changelog

  ananyahjha93

  committed
  00e4a65

  Copy full SHA for 00e4a65

• black

  ananyahjha93

  committed
  fc47a4d

  Copy full SHA for fc47a4d

• config

  ananyahjha93

  committed
  6a00cf4

  Copy full SHA for 6a00cf4

• added config for 750M

  ananyahjha93

  committed
  d719277

  Copy full SHA for d719277

• type

  ananyahjha93

  committed
  252f470

  Copy full SHA for 252f470

• updated config to run on pluto

  ananyahjha93

  committed
  25e1704

  Copy full SHA for 25e1704

• Update olmo/train.py

  Show description for e512582
  

  ananyahjha93

  and

  epwalsh

  authored
  e512582

  Copy full SHA for e512582

• fixed bug where flops count will not accumulate after resume

  ananyahjha93

  committed
  6effc3e

  Copy full SHA for 6effc3e

• 60M run

  ananyahjha93

  committed
  2caad7e

  Copy full SHA for 2caad7e

Commits on Jun 25, 2024

• updated model and config from Pete's branch

  ananyahjha93

  committed
  ed6b9a6

  Copy full SHA for ed6b9a6

• 60M run

  ananyahjha93

  committed
  08a5f91

  Copy full SHA for 08a5f91

• added back flops calc

  ananyahjha93

  committed
  db23930

  Copy full SHA for db23930

• 20M run on pluto

  ananyahjha93

  committed
  dbd0a87

  Copy full SHA for dbd0a87

• 60M run

  ananyahjha93

  committed
  13a4d52

  Copy full SHA for 13a4d52

• 20M run on pluto

  ananyahjha93

  committed
  c8e65f8

  Copy full SHA for c8e65f8

• 60M run

  ananyahjha93

  committed
  c9768da

  Copy full SHA for c9768da

• 20M run on pluto

  ananyahjha93

  committed
  1b52914

  Copy full SHA for 1b52914

• 60M run

  ananyahjha93

  committed
  5dbe772

  Copy full SHA for 5dbe772

Commits on Jun 26, 2024

• 150M run on jupiter

  ananyahjha93

  committed
  71621a1

  Copy full SHA for 71621a1

Commits on Jun 27, 2024

• .

  ananyahjha93

  committed
  8dba3b3

  Copy full SHA for 8dba3b3

• 300M

  ananyahjha93

  committed
  07b6d4a

  Copy full SHA for 07b6d4a

Commits on Jun 28, 2024

• .

  ananyahjha93

  committed
  3330468

  Copy full SHA for 3330468

• Merge branch 'main' into olmo-tiny

  ananyahjha93

  authored
  943e090

  Copy full SHA for 943e090

• Merge branch 'olmo-tiny' of ssh://github.com/allenai/OLMo into olmo-tiny

  ananyahjha93

  committed
  ce582c9

  Copy full SHA for ce582c9

• added back first_batch

  ananyahjha93

  committed
  b988efb

  Copy full SHA for b988efb