haormj / llama2.go Public

Notifications You must be signed in to change notification settings
Fork 1
Star 16

Inference Llama 2 in one file of pure go

16 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
cmd		cmd
.gitignore		.gitignore
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
go.env		go.env
go.mod		go.mod
go.sum		go.sum
main.go		main.go

Repository files navigation

llama2.go

ref llama2.c, golang version

Usage

make
# download model.bin and tokenizer.bin to _output from https://github.com/karpathy/llama2.c
cd _output
./llama2 run

About

Inference Llama 2 in one file of pure go

inference llama large-language-models llm llama2

Report repository

Releases

No releases published

Packages

No packages published

Languages