huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 10:26:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,278 Commits 74 Branches 16 Tags
8a49e01b9d9e13732d83f79afa2f850e2ba7fdae
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
8a49e01b9d Add the remaining quantized tests to the wasm suite. (#980) 2023-09-28 08:42:56 +01:00
Laurent Mazare
9cb110c44c Sketch a simd128 optimized q4k vecdot. (#977) 
* Sketch a simd128 optimized q4k vecdot.

* Simdify.

* More quantization optimizations.

* Again more simdification.

* Simdify the splitting loop.
 2023-09-27 20:19:38 +01:00
Laurent Mazare
667f01c173 Simd128 vec-dot for q4_0. (#974) 
* Simd128 vec-dot for q4_0.

* Bugfix.

* Add wasm tests.

* Bugfix for the q40 vecdot.

* More quantization tests.
 2023-09-27 14:15:30 +01:00