Skip to content

Update README #187

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Apr 29, 2024
Merged

Update README #187

merged 8 commits into from
Apr 29, 2024

Conversation

msaroufim
Copy link
Member

@msaroufim msaroufim commented Apr 29, 2024

Note: I couldn't figure out where our int4 kernels are

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 29, 2024
@msaroufim msaroufim force-pushed the msaroufim/docfixes branch from 721d6d7 to 96ba718 Compare April 29, 2024 17:58

1. From PyPI:
Stable Release
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

README.md Outdated
# perform autoquantization
torchao.autoquant(model, (input))

# compile the model to improve performance
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is required. without it it'll be guaranteed to be slower.

model(input)
```

### Sparsity
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cc @jcaip

Copy link
Contributor

@cpuhrsch cpuhrsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great! See inline comments.

@msaroufim msaroufim merged commit 808a397 into main Apr 29, 2024
8 of 11 checks passed
@msaroufim msaroufim deleted the msaroufim/docfixes branch April 29, 2024 22:38
dbyoung18 pushed a commit to dbyoung18/ao that referenced this pull request Jul 31, 2024
* Update README

* yolo

* yolo

* Update README.md

* yolo

* yolo

* yolo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants