-
Notifications
You must be signed in to change notification settings - Fork 336
Delete Galore #2397
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Delete Galore #2397
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/2397
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New FailureAs of commit a221df9 with merge base e29b9bd ( NEW FAILURE - The following job has failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR removes the entire experimental GaLore prototype—including its utilities, kernels, documentation, tests, benchmarks, and third-party submodule—to clean up the repository.
- Deletes all
torchao/prototype/galore
code, docs, and tests - Removes GaLore entries from the prototype README
Reviewed Changes
Copilot reviewed 17 out of 17 changed files in this pull request and generated no comments.
Show a summary per file
File | Description |
---|---|
torchao/prototype/galore/utils.py | Removed GaLore utility functions |
torchao/prototype/galore/kernels/adam_downproj_fused.py | Removed fused Adam+projection Triton kernel |
torchao/prototype/galore/docs/galore_adam8bit.md | Deleted 8-bit optimizer documentation |
torchao/prototype/galore/docs/README.md | Deleted GaLore docs index |
torchao/prototype/galore/README.md | Deleted GaLore prototype README |
torchao/prototype/README.md | Removed GaLore bullets from prototype code structure |
third_party/cutlass | Removed Cutlass submodule |
test/quantization/test_galore_quant.py | Removed GaLore quantization tests |
test/kernel/test_galore_downproj.py | Removed GaLore down-projection kernel tests |
test/kernel/test_fused_kernels.py | Removed GaLore fused-kernels tests |
test/kernel/galore_test_utils.py | Removed GaLore test utilities |
test/galore/profile_memory_usage.py | Removed GaLore memory profiling script |
test/galore/README.md | Deleted GaLore tests README |
benchmarks/fused_benchmark_utils.py | Removed GaLore benchmark utilities |
benchmarks/bench_galore_fused_kernels.py | Removed GaLore fused-kernels benchmark script |
* Delete Galore * restore cutlass changes
This was a temporarily fashionable technique at the time but didn't get any meaningful adoption so deleting considering we have other more ao'ish alternatives like low bit optimizers
I'll merge, thanks!