mirror of https://github.com/huggingface/candle.git synced 2025-06-15 10:26:33 +00:00

Files

Laurent Mazare 2817643db9 Add the mmv kernels for small batch sizes. (#2075 )

* Add the mmv kernels for smaller sizes.

* Support more mmv kernels.

* Use the new kernels.

* Fix the call.

* Silly fix.

* Improve the testing.

* Fix for dmmv.

* Add another dedicated test for the batching mmv.

2024-04-16 21:30:51 +02:00

src

Add the mmv kernels for small batch sizes. (#2075 )

2024-04-16 21:30:51 +02:00

build.rs

Ensure that the kernels get rebuilt on cuh changes. (#1954 )

2024-03-28 06:56:48 +01:00

Cargo.toml

Bumping the version number to 0.5.0. (#2009 )

2024-04-04 17:48:45 +02:00

README.md

Revert "Add the layer norm files. (#222 )" (#223 )

2023-07-22 16:51:11 +01:00

README.md

candle-kernels

This crate contains CUDA kernels used from candle. Some of these implementations come from the dfdx crate.