huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-20 12:06:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,068 Commits 74 Branches 16 Tags
2b10aaa05d3752186899bd5b5364d92164edc7ef
Commit Graph

6 Commits

Author SHA1 Message Date
Laurent Mazare
8a05743a21 Add StorageRef. (#2113) 
* Add the storage-ref bits.

* Add the metal implementation.
 2024-04-23 13:23:27 +02:00
Laurent Mazare
53e5380bf6 Add a synchronize method to devices. (#2055) 
* Add a synchronize method to devices.

* Metal version.
 2024-04-14 16:32:55 +02:00
Laurent Mazare
6708870e63 Add the alloc_uninit function. (#1901) 
* Add the alloc_uninit function.

* Dummy metal fix.

* Lazy initialization.
 2024-03-22 07:25:23 +01:00
Laurent Mazare
ec97c98e81 Async tensor copying. (#1900) 2024-03-21 13:09:42 +01:00
Laurent Mazare
ce9fbc3682 Optimize the cat operation on contiguous tensors (#1855) 
* Add a specialized kernel for copy2d.

* Move the cat operations.

* Avoid transpositions in cat.

* Bugfix.

* Bugfix for the cuda kernel.

* Add a benchmark.

* Add more testing.

* Test fix.

* Faster kernel.

* Add the missing kernel.

* Tweak the test.

* Add a metal kernel.

* Fix for the metal kernel.

* Get the tests to pass on metal.

* Also use this opportunity to fix the metal kernel for ELU.

* Add some bf16 kernels.

* Clippy fixes.
 2024-03-17 10:49:13 +01:00
Nicolas Patry
26c4e5bf1d Metal part 1 - Scaffolding for metal. (#1308) 
* Metal part 1 - Scaffolding for metal.

* Remove tracing.
 2023-11-10 08:35:48 +01:00