Skip to content

[minor] fix: use init_empty_weights instead of torch.device("meta")#1587

Merged
vermouth1992 merged 1 commit intoverl-project:mainfrom
0x404:fix_meta_ckpt
May 21, 2025
Merged

[minor] fix: use init_empty_weights instead of torch.device("meta")#1587
vermouth1992 merged 1 commit intoverl-project:mainfrom
0x404:fix_meta_ckpt

Conversation

@0x404
Copy link
Copy Markdown
Collaborator

@0x404 0x404 commented May 19, 2025

Checklist Before Starting

  • Search for similar PR(s).

What does this PR do?

A very minor fix as #1564, forgot to also update fsdp checkpoint manager to use init_empty_weights.

Additional Info.

  • Training: FSDP
  • Inference: none

Checklist Before Submitting

  • Read the Contribute Guide.
  • Apply pre-commit checks.
  • Add [BREAKING] to the PR title if it breaks any API.
  • Update the documentation about your changes in the docs.
  • Add CI test(s) if necessary.

@vermouth1992 vermouth1992 enabled auto-merge (squash) May 20, 2025 23:09
@vermouth1992 vermouth1992 merged commit d475654 into verl-project:main May 21, 2025
33 of 34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants