Dequant improvements rebase#8255

Merged

airMeng merged 4 commits intoggml-org:masterfrom

AidanBeltonS:dequant_improvements_rebase

Jul 3, 2024

Commits on Jul 2, 2024

Remove double lines
Aidan
committed
Single load for half2
Aidan
committed
Store scales in local mem
Aidan
committed
Vec load quantized values
Aidan
committed