Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add llama 3.1 8b and 70b #344

Merged
merged 6 commits into from
Jul 28, 2024
Merged

feat: add llama 3.1 8b and 70b #344

merged 6 commits into from
Jul 28, 2024

Conversation

sozercan
Copy link
Owner

@sozercan sozercan commented Jul 28, 2024

What this PR does / why we need it:

  • add llama 3.1 8b and 70b
  • deprecate llama3 and llama 2 models

Which issue(s) this PR fixes (optional, using fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when the PR gets merged):
Fixes #

Special notes for your reviewer:

sozercan added 6 commits July 28, 2024 00:14
Signed-off-by: Sertac Ozercan <[email protected]>
Signed-off-by: Sertac Ozercan <[email protected]>
Signed-off-by: Sertac Ozercan <[email protected]>
Signed-off-by: Sertac Ozercan <[email protected]>
Signed-off-by: Sertac Ozercan <[email protected]>
Signed-off-by: Sertac Ozercan <[email protected]>
@sozercan sozercan merged commit 5314e34 into main Jul 28, 2024
15 checks passed
@sozercan sozercan deleted the llama3.1 branch July 28, 2024 05:30
@reneleonhardt
Copy link
Contributor

Thank you, it's a superb model!
I can't find new / updated images, does every user have to build llama-3.1-8b-instruct himself instead of the usual docker run instructions?
https://github.com/sozercan/aikit#cpu
https://github.com/sozercan/aikit/pkgs/container/llama3
https://github.com/sozercan?tab=packages

@sozercan
Copy link
Owner Author

sozercan commented Jul 28, 2024

@reneleonhardt they are available now: https://sozercan.github.io/aikit/docs/premade-models

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants