Skip to content

Commit

Permalink
Merge branch 'microsoft:master' into LoCo-Zero++
Browse files Browse the repository at this point in the history
  • Loading branch information
XingyuXie authored Nov 20, 2024
2 parents 8cd96ab + 83e4364 commit 11cb119
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deepspeed/runtime/zero/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -322,7 +322,7 @@ class DeepSpeedZeroConfig(DeepSpeedConfigModel):
See LoCo paper for more details: (https://arxiv.org/abs/2407.04480).
"""

mics_shard_size: int = Field(-1, new_param="mics_shard_size")
mics_shard_size: int = Field(-1, json_schema_extra={"new_param": "mics_shard_size"})

mics_hierarchical_params_gather: bool = False

Expand Down

0 comments on commit 11cb119

Please sign in to comment.