mirror of
https://github.com/huggingface/candle.git
synced 2025-06-18 03:28:50 +00:00

* add `q2k` vec-dot * `q3k` vec-dot + quantization bugfix * `q4k` vec-dot * `q5k` vec-dot * Validate against GGML unit test results. * Remove some more `transmutes`