Skip to content

Conversation

@ydshieh
Copy link
Collaborator

@ydshieh ydshieh commented Jan 9, 2025

What does this PR do?

Not all experts will get grad in a forward call.

@ydshieh ydshieh merged commit 82dd6c1 into main Jan 9, 2025
26 checks passed
@ydshieh ydshieh deleted the fix_grad_ckpt branch January 9, 2025 14:36
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Collaborator Author

@ydshieh ydshieh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't even remember it was me introduce this variable test_all_params_have_gradient. I am so good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants