Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merging the train-olmo-large branch #599

Merged
merged 53 commits into from
May 30, 2024
Merged

Merging the train-olmo-large branch #599

merged 53 commits into from
May 30, 2024

Commits on May 6, 2024

  1. Llamaish7 config, finally

    @dirkgr
    dirkgr committed May 6, 2024
    Configuration menu
    Copy the full SHA
    351f431 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. Create way more detailed artifacts

    @dirkgr
    dirkgr committed May 7, 2024
    Configuration menu
    Copy the full SHA
    4d3afa6 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. Plan C: backtrack, cut LR in half

    @epwalsh
    epwalsh committed May 8, 2024
    Configuration menu
    Copy the full SHA
    732b397 View commit details
    Browse the repository at this point in the history

  2. fix branch

    @epwalsh
    epwalsh committed May 8, 2024
    Configuration menu
    Copy the full SHA
    59034d6 View commit details
    Browse the repository at this point in the history

  3. pile llamaish

    @AkshitaB
    AkshitaB committed May 8, 2024
    Configuration menu
    Copy the full SHA
    7015172 View commit details
    Browse the repository at this point in the history

  4. try on jupiter

    @AkshitaB
    AkshitaB committed May 8, 2024
    Configuration menu
    Copy the full SHA
    26ba864 View commit details
    Browse the repository at this point in the history

  5. Resume the detailed llamaish run

    @dirkgr
    dirkgr committed May 8, 2024
    Configuration menu
    Copy the full SHA
    453fed1 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'train-olmo-large' of https://github.com/allenai/LLM int… 

    …o train-olmo-large
    @dirkgr
    dirkgr committed May 8, 2024
    Configuration menu
    Copy the full SHA
    612934b View commit details
    Browse the repository at this point in the history

  7. fix filename

    @AkshitaB
    AkshitaB committed May 8, 2024
    Configuration menu
    Copy the full SHA
    3ce4ec9 View commit details
    Browse the repository at this point in the history

  8. run on pluto

    @AkshitaB
    AkshitaB committed May 8, 2024
    Configuration menu
    Copy the full SHA
    05b8f39 View commit details
    Browse the repository at this point in the history

  9. whitelist nodes

    @epwalsh
    epwalsh committed May 8, 2024
    Configuration menu
    Copy the full SHA
    391a537 View commit details
    Browse the repository at this point in the history

  10. lumi config

    @AkshitaB
    AkshitaB committed May 8, 2024
    Configuration menu
    Copy the full SHA
    c541af1 View commit details
    Browse the repository at this point in the history

  11. lumi script

    @AkshitaB
    AkshitaB committed May 8, 2024
    Configuration menu
    Copy the full SHA
    4095258 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2024

  1. jupiter

    @AkshitaB
    AkshitaB committed May 9, 2024
    Configuration menu
    Copy the full SHA
    92496f4 View commit details
    Browse the repository at this point in the history

  2. increase sync timeout

    @AkshitaB
    AkshitaB committed May 9, 2024
    Configuration menu
    Copy the full SHA
    c1816db View commit details
    Browse the repository at this point in the history

  3. load from path

    @AkshitaB
    AkshitaB committed May 9, 2024
    Configuration menu
    Copy the full SHA
    d37125a View commit details
    Browse the repository at this point in the history

  4. fix

    @AkshitaB
    AkshitaB committed May 9, 2024
    Configuration menu
    Copy the full SHA
    45e407b View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. update config for restart

    @epwalsh
    epwalsh committed May 10, 2024
    Configuration menu
    Copy the full SHA
    420d6dd View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. update config

    @epwalsh
    epwalsh committed May 13, 2024
    Configuration menu
    Copy the full SHA
    05ad705 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. Try stop wandb from flaking at cancel

    @2015aroras @dirkgr
    2015aroras authored and dirkgr committed May 14, 2024
    Configuration menu
    Copy the full SHA
    06fc94f View commit details
    Browse the repository at this point in the history

Commits on May 16, 2024

  1. Configure mitchish7 to continue (with the datafix)

    @dirkgr
    dirkgr committed May 16, 2024
    Configuration menu
    Copy the full SHA
    1e603a8 View commit details
    Browse the repository at this point in the history

  2. I am normal.

    @dirkgr
    dirkgr committed May 16, 2024
    Configuration menu
    Copy the full SHA
    52cfe84 View commit details
    Browse the repository at this point in the history

  3. This is supposed to run on Jupiter.

    @dirkgr
    dirkgr committed May 16, 2024
    Configuration menu
    Copy the full SHA
    5c8b115 View commit details
    Browse the repository at this point in the history

Commits on May 18, 2024

  1. Config for a restart with constant LR

    @dirkgr
    dirkgr committed May 18, 2024
    Configuration menu
    Copy the full SHA
    45acb65 View commit details
    Browse the repository at this point in the history

  2. Fix OLMo-core

    @dirkgr
    dirkgr committed May 18, 2024
    Configuration menu
    Copy the full SHA
    b394ac2 View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Need to specify nodes

    @dirkgr
    dirkgr committed May 20, 2024
    Configuration menu
    Copy the full SHA
    5f14392 View commit details
    Browse the repository at this point in the history

  2. Fix OLMo-core

    @dirkgr
    dirkgr committed May 20, 2024
    Configuration menu
    Copy the full SHA
    b8b4368 View commit details
    Browse the repository at this point in the history

  3. New nodes

    @dirkgr
    dirkgr committed May 20, 2024
    Configuration menu
    Copy the full SHA
    7a6d39d View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. Continue running the 70B on Jupiter

    @dirkgr
    dirkgr committed May 21, 2024
    Configuration menu
    Copy the full SHA
    a03bbf2 View commit details
    Browse the repository at this point in the history

  2. Run in the proper workspace

    @dirkgr
    dirkgr committed May 21, 2024
    Configuration menu
    Copy the full SHA
    3f5f019 View commit details
    Browse the repository at this point in the history

  3. Run as me

    @dirkgr
    dirkgr committed May 21, 2024
    Configuration menu
    Copy the full SHA
    8fc56c1 View commit details
    Browse the repository at this point in the history

  4. Run preemptible

    @dirkgr
    dirkgr committed May 21, 2024
    Configuration menu
    Copy the full SHA
    8d74d6c View commit details
    Browse the repository at this point in the history

  5. Multiple clusters

    @dirkgr
    dirkgr committed May 21, 2024
    Configuration menu
    Copy the full SHA
    6f8a909 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. Formatting

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    96b1bcb View commit details
    Browse the repository at this point in the history

  2. Improve the script that dry-runs the dataloader

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    a7e6588 View commit details
    Browse the repository at this point in the history

  3. Off by one

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    44f3c2d View commit details
    Browse the repository at this point in the history

  4. Save in torch format

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    613715c View commit details
    Browse the repository at this point in the history

  5. Revert "Save in torch format" 

    This reverts commit 613715c.
    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    1c22396 View commit details
    Browse the repository at this point in the history

  6. Reapply "Save in torch format" 

    This reverts commit 1c22396.
    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    055eff7 View commit details
    Browse the repository at this point in the history

  7. Torch doesn't have an uint16 type.

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    446e90b View commit details
    Browse the repository at this point in the history

  8. Merge remote-tracking branch 'origin/main' into train-olmo-large 

    # Conflicts:
#	olmo/checkpoint.py
#	olmo/train.py
    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    9c809e6 View commit details
    Browse the repository at this point in the history

  9. Silence warning

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    99c71f7 View commit details
    Browse the repository at this point in the history

  10. Silence another warning

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    bed4324 View commit details
    Browse the repository at this point in the history

  11. isort

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    4beb980 View commit details
    Browse the repository at this point in the history

  12. Run preemptible

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    60d90f4 View commit details
    Browse the repository at this point in the history

  13. More clusters

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    d5912f9 View commit details
    Browse the repository at this point in the history

  14. preemptible

    @dirkgr
    dirkgr committed May 29, 2024
    Configuration menu
    Copy the full SHA
    16fad9d View commit details
    Browse the repository at this point in the history

Commits on May 30, 2024

  1. Remove usages of Auto* methods in hf_olmo tests

    @2015aroras
    2015aroras committed May 30, 2024
    Configuration menu
    Copy the full SHA
    9383d29 View commit details
    Browse the repository at this point in the history

  2. Make test_config_save save to temp file

    @2015aroras
    2015aroras committed May 30, 2024
    Configuration menu
    Copy the full SHA
    86f7f97 View commit details
    Browse the repository at this point in the history

  3. Run ruff

    @2015aroras
    2015aroras committed May 30, 2024
    Configuration menu
    Copy the full SHA
    5b98858 View commit details
    Browse the repository at this point in the history

  4. This should respect the default.

    @dirkgr
    dirkgr committed May 30, 2024
    Configuration menu
    Copy the full SHA
    f7f0f88 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'origin/shanea/fix-hf-olmo-tests' into t… 

    …rain-olmo-large
    @dirkgr
    dirkgr committed May 30, 2024
    Configuration menu
    Copy the full SHA
    20f5213 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into train-olmo-large

    @dirkgr
    dirkgr authored May 30, 2024
    Configuration menu
    Copy the full SHA
    cb4af89 View commit details
    Browse the repository at this point in the history