You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Venho.AI project builds a personal AI assistant based on the Rockchip RK3588 platform (see their first custom-build edge device "Jolla Mind2"). Like many other projects using the Rockchip NPU, they face an issue with the proprietary closed-source librkllm_api user space library that is needed to speed up interference with the model.
My wish would be to open-source that library like you did with the kernel driver and conversation tools to help these projects to keep everything as open as possible. It would also help to keep the bindings working in the future if updated Linux distributions are used on the device that eventually break libc compatibility with the closed-source library.
The text was updated successfully, but these errors were encountered:
The Venho.AI project builds a personal AI assistant based on the Rockchip RK3588 platform (see their first custom-build edge device "Jolla Mind2"). Like many other projects using the Rockchip NPU, they face an issue with the proprietary closed-source
librkllm_api
user space library that is needed to speed up interference with the model.My wish would be to open-source that library like you did with the kernel driver and conversation tools to help these projects to keep everything as open as possible. It would also help to keep the bindings working in the future if updated Linux distributions are used on the device that eventually break libc compatibility with the closed-source library.
The text was updated successfully, but these errors were encountered: