huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-20 12:06:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,068 Commits 74 Branches 16 Tags
2b10aaa05d3752186899bd5b5364d92164edc7ef
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
b13a82a438 Separate quantized phi-3 implementation. (#2157) 
* Separate quantized phi-3 implementation.

* Integrate the quantized phi3 model.=

* Small fixes, get the generation to work properly.

* Keep the old llama implementation around.

* Change the default.
 2024-05-04 10:14:57 +02:00
Laurent Mazare
805f3be8e1 Add a sort function. (#2134) 2024-04-28 08:18:04 +02:00
Laurent Mazare
96a48e5cc4 Add argsort. (#2132) 
* Add the argsort cuda kernels.

* CPU version of arg-sort.

* Hook the cuda kernel + rework the cpu bits.

* Add some dedicated test.

* Working cuda kernel.

* Metal kernel.

* Metal adjustments.

* Bugfix.

* Use the fast rope in qwen.

* Rework the expert selection in qwen.
 2024-04-27 20:17:35 +02:00