Support RWKV4 Raven/World RWKV5 / RWKV6 World/Finch 1B5-14B (ggml) (CPU/GPU)

Use

Development Environment: Windows, Visual Studio 2022

git clone https://github.com/imxcstar/RWKVSharp.git

cd RWKVSharp

git submodule update --progress --init --remote

git submodule update --progress --init --recursive

Download model from Hugging Face

Open RWKVSharp.sln

Compile the RWKVSharp.GGML.Convert project and then use this project to convert the downloaded model.

Compile the RWKVSharp.GGML.Test project, and then put the converted model model into the Model directory in the project.

Download rwkv native libraries for other systems

Model placement location

Preview

Reference Links

• RWKV Hugging Face repo: https://huggingface.co/RWKV
• rwkv.cpp: https://github.com/RWKV/rwkv.cpp
• RWKV: https://github.com/BlinkDL/RWKV-LM
• ChatRWKV: https://github.com/BlinkDL/ChatRWKV
• Tokenizer: https://github.com/Alex1911-Jiang/GPT-3-Encoder-Sharp