mirror of https://github.com/huggingface/candle.git synced 2025-06-15 10:26:33 +00:00

Files

Laurent Mazare 1b98f84a2b Fast kernels for rotary embeddings. (#1928 )

* Fast kernels for rotary embeddings.

* Add a test for the fast CPU kernel.

* Rope cuda bindings.

* Cuda kernel.

* Metal kernel (part 1).

* Cuda kernels.

* Finish the metal kernel.

* Use the new kernels in the quantized example.

* Fix warning.

2024-03-24 22:48:52 +01:00

src

Fast kernels for rotary embeddings. (#1928 )

2024-03-24 22:48:52 +01:00

build.rs

Moving to a proper build crate bindgen_cuda. (#1531 )

2024-01-07 12:29:24 +01:00

Cargo.toml

Bump the crate versions to 0.4.2. (#1821 )

2024-03-08 22:01:51 +01:00

README.md

Revert "Add the layer norm files. (#222 )" (#223 )

2023-07-22 16:51:11 +01:00

README.md

candle-kernels

This crate contains CUDA kernels used from candle. Some of these implementations come from the dfdx crate.