mirror of
https://github.com/huggingface/candle.git
synced 2025-06-16 10:38:54 +00:00

* Add vecdot for q6k-q8k. * Add some testing for q8k. * Use QMatMul for the output layer.
* Add vecdot for q6k-q8k. * Add some testing for q8k. * Use QMatMul for the output layer.