Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for GPT-J models #11

Closed
versae opened this issue Oct 9, 2023 · 2 comments · Fixed by #13
Closed

Add support for GPT-J models #11

versae opened this issue Oct 9, 2023 · 2 comments · Fixed by #13
Labels
enhancement New feature or request

Comments

@versae
Copy link

versae commented Oct 9, 2023

Any chance of adding support for GPT-J models?
@tomaarsen tomaarsen added the enhancement New feature or request label Oct 9, 2023
@tomaarsen
Copy link
Owner

Great suggestion - will look into it.

@tomaarsen tomaarsen mentioned this issue Oct 10, 2023
Merged
@versae
Copy link
Author

versae commented Oct 11, 2023

That was fast! 🙌🏼

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add GPT-J support + benchmark results tomaarsen/attention_sinks
2 participants
@versae @tomaarsen