Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Mac Python Binding] zsh: illegal hardware instruction python3 web_demo.py -m ../chatglm2-ggml.bin #58

Open
Robin2333 opened this issue Jul 19, 2023 · 11 comments

Comments

@Robin2333
Copy link

./build/bin/main -m chatglm-ggml.bin -i 可以正常使用
但是使用cd examples && python3 cli_chat.py -m ../chatglm2-ggml.bin -i 的时候报错显示
zsh: illegal hardware instruction python3 web_demo.py -m ../chatglm2-ggml.bin

@Zach-Yu404
Copy link

我也遇到这个问题了,请问你解决了吗?

@pengxiulin
Copy link

同样遇到这个问题,examples里面的 cli_chat.py和 web_demo.py 两个文件都会报错。
看了一下,是执行到这句的时候报的错:pipeline = chatglm_cpp.Pipeline(args.model)

环境是mac m1

[email protected]
[email protected]

@Robin2333
Copy link
Author

这个问题我解决了。我同样是mac m1。我不太清楚原因,但解决的方式很简单——新建了一个Python环境,只安装必要的库(甚至不包括torch),问题就自然解决了。

@pengxiulin
Copy link

终于找到原因了:
之前的conda版本所安装的python是x86格式的,卸载重装了一个arm版的conda,然后安装了一个新环境,确保是arm64的环境
image
安装后可以使用 file $(which python)命令查看python版本。
如果是这个就是正常的:Mach-O 64-bit executable arm64e

@victoryangn
Copy link

[ import chatglm_cpp._C as _C
ModuleNotFoundError: No module named 'chatglm_cpp._C'

有谁遇到这个问题么](zsh: illegal hardware instruction python3 cli_chat.py -m ../chatglm-ggml.bin -i)

@guoduan127
Copy link

[ import chatglm_cpp._C as _C ModuleNotFoundError: No module named 'chatglm_cpp._C'

有谁遇到这个问题么](zsh: illegal hardware instruction python3 cli_chat.py -m ../chatglm-ggml.bin -i)

这个问题,可以尝试pwd离开chatglm_cpp根目录,换到其他目录可以避开

@guoduan127
Copy link

guoduan127 commented Nov 5, 2023

仅供参考:完全一样的部署操作,cpu 是e5 1220v2(win10),e5 2620V2(server 2022)都不行,另外两台可以,一台cpu是i5 i5-10400F,一台 i7-10750H。难道是指令集不一样?AVX2?

@jingxuansd
Copy link

$ ./build/bin/main -m chatglm3-ggml.bin -p 你好 --top_p 0.8 --temp 0.8
[1] 93052 illegal hardware instruction ./build/bin/main -m chatglm3-ggml.bin -p 你好 --top_p 0.8 --temp 0.8

我遇到了同样的问题,Mac mini M1

@oldturkey
Copy link

我遇到了同样的问题,Mbp M2

@taliszhou
Copy link

这个问题还没得到解决吗

@jeceldx
Copy link

jeceldx commented Dec 27, 2023

同样的问题,web-demo一样跑不起来?提示ImportError: dlopen(/opt/homebrew/lib/python3.10/site-packages/chatglm_cpp/_C.cpython-310-darwin.so, 0x0002): tried: '/opt/homebrew/lib/python3.10/site-packages/chatglm_cpp/_C.cpython-310-darwin.so' (mach-o file, but is an incompatible architecture (have (x86_64), need (arm64e))),这不知道为啥我本地编译完安装的是x86的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants