Kawrakow
ikawrakow's picture ggerganov's picture
Adding IQ2_S and IQ2_M to complete coverage of the 2-3 bit quantization range (llama/5721)
2b9bb9e unverified