huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-22 20:38:06 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,277 Commits 74 Branches 16 Tags
9cb110c44c10145efefe3555ae8b9f91f4161fe2
Commit Graph

2 Commits

Author SHA1 Message Date
Laurent Mazare
9cb110c44c Sketch a simd128 optimized q4k vecdot. (#977) 
* Sketch a simd128 optimized q4k vecdot.

* Simdify.

* More quantization optimizations.

* Again more simdification.

* Simdify the splitting loop.
 2023-09-27 20:19:38 +01:00
Laurent Mazare
667f01c173 Simd128 vec-dot for q4_0. (#974) 
* Simd128 vec-dot for q4_0.

* Bugfix.

* Add wasm tests.

* Bugfix for the q40 vecdot.

* More quantization tests.
 2023-09-27 14:15:30 +01:00