Files
candle/candle-core
Lukas Kreussel c72eb3d75b Add reference implementation for q4k and q5k (#586)
* add `q2k` vec-dot

* `q3k` vec-dot + quantization bugfix

* `q4k` vec-dot

* `q5k` vec-dot

* Validate against GGML unit test results.

* Remove some more `transmutes`
2023-08-26 12:07:54 +01:00
..
2023-08-24 18:45:10 +01:00
2023-06-27 11:57:27 +02:00
2023-06-27 11:57:27 +02:00

candle

Minimalist ML framework for Rust