huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 11:37:11 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,985 Commits 74 Branches 16 Tags
3754b834f42cc49360aed7a1095d2ff8f732858b
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
b190fd8592 Remove some unnecessary calls to contiguous. (#1968) 
* Remove some unnecessary calls to contiguous.

* Slightly improved kv cache concatenation.
 2024-03-30 13:22:00 +01:00
Laurent Mazare
6708870e63 Add the alloc_uninit function. (#1901) 
* Add the alloc_uninit function.

* Dummy metal fix.

* Lazy initialization.
 2024-03-22 07:25:23 +01:00
Laurent Mazare
ce9fbc3682 Optimize the cat operation on contiguous tensors (#1855) 
* Add a specialized kernel for copy2d.

* Move the cat operations.

* Avoid transpositions in cat.

* Bugfix.

* Bugfix for the cuda kernel.

* Add a benchmark.

* Add more testing.

* Test fix.

* Faster kernel.

* Add the missing kernel.

* Tweak the test.

* Add a metal kernel.

* Fix for the metal kernel.

* Get the tests to pass on metal.

* Also use this opportunity to fix the metal kernel for ELU.

* Add some bf16 kernels.

* Clippy fixes.
 2024-03-17 10:49:13 +01:00