Skip to content

call rwkv v4/v5/v6 raven/world/finch 1B5-14B ggml using csharp cpu/gpu (support INT4,8,Float16,32)

License

Notifications You must be signed in to change notification settings

imxcstar/RWKVSharp

Repository files navigation

Support RWKV4 Raven/World RWKV5 / RWKV6 World/Finch 1B5-14B (ggml) (CPU/GPU)

Use

Development Environment: Windows, Visual Studio 2022

git clone https://github.com/imxcstar/RWKVSharp.git

cd RWKVSharp

git submodule update --progress --init --remote

git submodule update --progress --init --recursive

Download model from Hugging Face

Open RWKVSharp.sln

Compile the RWKVSharp.GGML.Convert project and then use this project to convert the downloaded model.

Compile the RWKVSharp.GGML.Test project, and then put the converted model model into the Model directory in the project.

Download rwkv native libraries for other systems

Model placement location

3.png

Preview

1.png

2.png

Reference Links

About

call rwkv v4/v5/v6 raven/world/finch 1B5-14B ggml using csharp cpu/gpu (support INT4,8,Float16,32)

Resources

License

Stars

Watchers

Forks

Packages

No packages published