Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[librkllm_api]: Please open source API user space bindings #219

Open
nekrondev opened this issue Mar 12, 2025 · 0 comments
Open

[librkllm_api]: Please open source API user space bindings #219

nekrondev opened this issue Mar 12, 2025 · 0 comments

Comments

@nekrondev
Copy link

The Venho.AI project builds a personal AI assistant based on the Rockchip RK3588 platform (see their first custom-build edge device "Jolla Mind2"). Like many other projects using the Rockchip NPU, they face an issue with the proprietary closed-source librkllm_api user space library that is needed to speed up interference with the model.

My wish would be to open-source that library like you did with the kernel driver and conversation tools to help these projects to keep everything as open as possible. It would also help to keep the bindings working in the future if updated Linux distributions are used on the device that eventually break libc compatibility with the closed-source library.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant