Is there a plan to support running Phi3 on the NPU of the Core Ultra #487
goxia
started this conversation in
Support for Targets (OS / EPs / Hardware)
Replies: 1 comment
-
|
Hi, thank you for the suggestion. I am moving this into our new targets Discussion so that we can look into it further |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently, when running Phi3 through LM Studio, the load can only be run on top of the GPU.
Beta Was this translation helpful? Give feedback.
All reactions