New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

如何提升CPU利用率 #183

Open

zhengxingmao opened this issue Nov 9, 2023 · 1 comment

zhengxingmao commented Nov 9, 2023 •

edited

Loading

lanchain_api 运行的时候只有8个线程，CPU只使用了一半，如何提高CPU利用率，比如增加线程数？

Owner

li-plus commented Nov 22, 2023

Pipeline.chat 里面有 num_threads 参数，默认是物理核的数量，可以调节下这个参数增加线程数。参考

chatglm.cpp/examples/web_demo.py

Line 45 in b071907

num_threads=args.threads,

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment