Discussions

• 1 You must be logged in to vote

  💬

  Will LQER improve k- and i-quants?

  ikawrakow started Aug 9, 2024 in General

  

  

  

  

  12
• 1 You must be logged in to vote

  🙌

  CPU beating GPU in token generation speed

  ikawrakow started Aug 13, 2024 in Show and tell

  

  

  2
• 3 You must be logged in to vote

  💬

  CPU prompt processing speed for large contexts

  ikawrakow started Aug 22, 2024 in General

  

  

  10
• 1 You must be logged in to vote

  🙌

  New quantization types IQ2_K, IQ3_K, IQ4_K, IQ5_K

  ikawrakow started Aug 1, 2024 in Show and tell

  

  

  0