Skip to content

Commit

Permalink
Fixes a weird typo (EleutherAI#1207)
Browse files Browse the repository at this point in the history
* Fixes a weird typo

* Update NeoXArgs docs automatically

---------

Co-authored-by: github-actions <[email protected]>
  • Loading branch information
StellaAthena and github-actions authored Apr 25, 2024
1 parent 703d02f commit 838d5bf
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion configs/neox_arguments.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,7 +111,7 @@ Logging Arguments

- **git_hash**: str

Default = 11a5537
Default = 4e37645

current git hash of repository

Expand Down
2 changes: 1 addition & 1 deletion megatron/training.py
Original file line number Diff line number Diff line change
Expand Up @@ -429,7 +429,7 @@ def get_model(neox_args, use_cache=False):
neox_args.use_mup = False

with deepspeed.zero.Init(
config_dict_or_path=neox_args.deespeed_config
config_dict_or_path=neox_args.deepspeed_config
) if neox_args.zero_stage == 3 else nullcontext() as gs:
model = GPT2ModelPipe(
neox_args=neox_args,
Expand Down

0 comments on commit 838d5bf

Please sign in to comment.