mirror of
https://github.com/huggingface/candle.git
synced 2025-06-20 04:00:28 +00:00

* add `q2k` vec-dot * `q3k` vec-dot + quantization bugfix * `q4k` vec-dot * `q5k` vec-dot * Validate against GGML unit test results. * Remove some more `transmutes`