Code

IQ1_S_R4: better 1.5 bpw quants#185

Code

Merged

ikawrakow merged 10 commits intomainikawrakow/ik_llama.cpp:mainfrom ik/iq1_s_r4ikawrakow/ik_llama.cpp:ik/iq1_s_r4Copy head branch name to clipboardFeb 5, 2025

+1,104-93

Commits

Commits on Feb 4, 2025

• iq1_s_r4: basics - quantize/dequantize

  Kawrakow

  committed
  db761f4

  Copy full SHA for db761f4

• iq1_s_r4: gemm/gemv works on AVX2/Zen4

  Kawrakow

  committed
  6e31b49

  Copy full SHA for 6e31b49

• Don't forget to make sure we have a multiple of 4 rows per thread

  Kawrakow

  committed
  83f02e2

  Copy full SHA for 83f02e2

• iq1_s_r4: this is better

  Kawrakow

  committed
  b9edce5

  Copy full SHA for b9edce5

• iq1_s_r4: fix Zen4 after AVX2 changes

  Kawrakow

  committed
  16fbe8e

  Copy full SHA for 16fbe8e

• iq1_s_r4: NEON gemm/gemv

  Kawrakow

  committed
  25ffa87

  Copy full SHA for 25ffa87

• iq1_s_r4: more bits for shared experts

  Show description for 19d3843
  Kawrakow

  committed
  19d3843

  Copy full SHA for 19d3843

Commits on Feb 5, 2025

• Forgotten counter increment

  Kawrakow

  committed
  0467c16

  Copy full SHA for 0467c16

• iq1_s_r4: slightly faster AVX2/Zen4 gemm/gemv

  Kawrakow

  committed
  56a6ee2

  Copy full SHA for 56a6ee2

• Compiler warnings

  Kawrakow

  committed
  3c9b116

  Copy full SHA for 3c9b116