huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 12:20:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,002 Commits 74 Branches 16 Tags
618ecf5e231beb5bd0b1e59a171eb9cb0af95b01
Commit Graph

4 Commits

Author SHA1 Message Date
Laurent Mazare
2ac302a5d1 Add the rope THD kernel. (#2014) 
* Add the rope THD kernel.

* Cuda kernel for rope-thd.

* Add the metal kernels.

* Add a dedicated test.
 2024-04-05 08:32:58 +02:00
Hugo Abonizio
60676780a9 Fix detail in new RoPE implementation (#1935) 2024-03-25 18:20:09 +01:00
Laurent Mazare
e7f8e72588 Contiguous variant of the rope kernel. (#1929) 
* Contiguous variant of the rope kernel.

* Add the cuda kernel.

* Metal kernel.
 2024-03-25 09:11:20 +01:00
Laurent Mazare
1b98f84a2b Fast kernels for rotary embeddings. (#1928) 
* Fast kernels for rotary embeddings.

* Add a test for the fast CPU kernel.

* Rope cuda bindings.

* Cuda kernel.

* Metal kernel (part 1).

* Cuda kernels.

* Finish the metal kernel.

* Use the new kernels in the quantized example.

* Fix warning.
 2024-03-24 22:48:52 +01:00