Use Fabrice Bellard's ts_server instead if you are looking for fast CPU inference
-
Notifications
You must be signed in to change notification settings - Fork 3
AXKuhta/rwkv-onnx-dml
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Run ONNX RWKV-v4 models with GPU acceleration using DirectML [Windows], or just on CPU [Windows AND Linux]; Limited to 430M model at this time because of .onnx 2GB file size limitation
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published