Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pr139 dev oct24 #29

Merged
merged 12 commits into from
Oct 20, 2024
Merged

Pr139 dev oct24 #29

merged 12 commits into from
Oct 20, 2024

Commits on Oct 18, 2024

  1. adding num hidden layers manipulation for all models

    @risingsunomi
    risingsunomi committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    d07b825 View commit details
    Browse the repository at this point in the history

  2. updating to use shard_num_hidden_layers

    @risingsunomi
    risingsunomi committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    a840e7f View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' of github.com:risingsunomi/exo-nvidia into pr139-… 

    …dev-oct24
    @risingsunomi
    risingsunomi committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    bf5f22d View commit details
    Browse the repository at this point in the history

  4. adding in better layer manipulation

    @risingsunomi
    risingsunomi committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    52fa3f8 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2024

  1. adding in safe tensor sharding, generate model.safetensors.index.json… 

    … from single safetensor, starting safetensor sharding test
    @risingsunomi
    risingsunomi committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    ec49e31 View commit details
    Browse the repository at this point in the history

  2. implementing sharding tests, fixing bugs with safetensor recompile

    @risingsunomi
    risingsunomi committed Oct 19, 2024
    Configuration menu
    Copy the full SHA
    f45b514 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2024

  1. adding safetensor sharding, implementing it into model inference engine

    @risingsunomi
    risingsunomi committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    f90c24a View commit details
    Browse the repository at this point in the history

  2. updating backup and backup restore

    @risingsunomi
    risingsunomi committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    696c264 View commit details
    Browse the repository at this point in the history

  3. added removing backup when restoring

    @risingsunomi
    risingsunomi committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    9514e92 View commit details
    Browse the repository at this point in the history

  4. added generating weight map if none, did updates to backup and restor… 

    …e process for sharding HF safetensors
    @risingsunomi
    risingsunomi committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    d65505e View commit details
    Browse the repository at this point in the history

  5. cleaning up logging

    @risingsunomi
    risingsunomi committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    d5b6113 View commit details
    Browse the repository at this point in the history

  6. updating docstring in newest class file

    @risingsunomi
    risingsunomi committed Oct 20, 2024
    Configuration menu
    Copy the full SHA
    d2302cc View commit details
    Browse the repository at this point in the history