-
Notifications
You must be signed in to change notification settings - Fork 283
Pull requests: facebookresearch/fairscale
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
support for grad acc
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1190
opened Aug 30, 2024 by
ngoyal2707
Loading…
Bump scikit-learn from 1.1.3 to 1.5.0
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
dependencies
Pull requests that update a dependency file
#1187
opened Jun 18, 2024 by
dependabot
bot
Loading…
FP8 AllGather Support in Fairscale
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1185
opened May 20, 2024 by
levendlee
Loading…
10 tasks
Llama4 FP8 Training Debug - fairscale
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1183
opened May 7, 2024 by
jiecaoyu
Loading…
10 tasks
Fix minor grammatical corrections in docs
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1181
opened Apr 29, 2024 by
aakashapoorv
Loading…
6 of 10 tasks
[FSDPv1] Only perform cat() during last microbatch backward() within FlattenParamsWrapper
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
[WIP] Make FSDPv1 only perform cat() during last microbatch backward() within FlattenParamsWrapper
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Make sure that tensor is contiguous before gathering across processes
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1173
opened Apr 1, 2024 by
patrickvonplaten
Loading…
Bump black from 22.3.0 to 24.3.0
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
dependencies
Pull requests that update a dependency file
#1169
opened Mar 20, 2024 by
dependabot
bot
Loading…
Fairscale support for only performing allreduce in last microbatch
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Fix params_with_grad in FSDP when the model has frozen parameters
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1167
opened Mar 4, 2024 by
whbldhwj
Loading…
1 of 10 tasks
Avoid calling _free_fp16_param_shard() too early
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1164
opened Feb 20, 2024 by
jiecaoyu
Loading…
10 tasks
Added reshard hook for frozen params in backward
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1159
opened Jan 12, 2024 by
awgu
Loading…
1 of 10 tasks
Add support for This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
torch.set_default_device
when initializing model parameters
CLA Signed
#1158
opened Dec 28, 2023 by
fshp971
Loading…
6 of 10 tasks
Fix _free_full_params()
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1149
opened Nov 21, 2023 by
hadasah
Loading…
10 tasks
Extend CheckpointFunction to track all tensor input/output
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1148
opened Nov 7, 2023 by
000Justin000
Loading…
6 of 10 tasks
[Not for merge] fp8allgather debug
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1147
opened Oct 29, 2023 by
jiecaoyu
Loading…
Add main grad before fwd pass
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Add main_grad
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1140
opened Oct 2, 2023 by
jianyuh
Loading…
10 tasks
Fp8 all gather hack
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1136
opened Sep 17, 2023 by
jspark1105
Loading…
Fix typo in ParallelEmbedding argument assignment
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1132
opened Aug 28, 2023 by
hessamb
Loading…
Add a context manager for activation sharding.
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1127
opened Jun 12, 2023 by
luyug
Loading…
added option to do backward AG over smaller set of gpus instead of full DDP world
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1125
opened May 20, 2023 by
ngoyal2707
Loading…
8 bit all_gather
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1105
opened Feb 14, 2023 by
ngoyal2707
Loading…
Fsdp ptd
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.