huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 18:28:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
1b98f84a2baa23192b97e36131011da658bfa1c2
candle/candle-nn
History
Laurent Mazare 1b98f84a2b Fast kernels for rotary embeddings. (#1928) 
* Fast kernels for rotary embeddings.

* Add a test for the fast CPU kernel.

* Rope cuda bindings.

* Cuda kernel.

* Metal kernel (part 1).

* Cuda kernels.

* Finish the metal kernel.

* Use the new kernels in the quantized example.

* Fix warning.
2024-03-24 22:48:52 +01:00
..
examples
Optimize the cat operation on contiguous tensors (#1855)
2024-03-17 10:49:13 +01:00
src
Fast kernels for rotary embeddings. (#1928)
2024-03-24 22:48:52 +01:00
tests
Fast kernels for rotary embeddings. (#1928)
2024-03-24 22:48:52 +01:00
Cargo.toml
Fast kernels for rotary embeddings. (#1928)
2024-03-24 22:48:52 +01:00
README.md
Add some missing readme files. (#304)
2023-08-02 10:57:12 +01:00

README.md

candle-nn