Skip to content

Is it possible that use candle library without CUDA? #2270

Discussion options

You must be logged in to vote

Solved, that's my mistake, I accidently turned on flash_attn.
When I turned it off, everything is fine.

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by dialogflowchatbot
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant