huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-20 20:09:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,666 Commits 74 Branches 16 Tags
3f04a79ada7ca974176a0c7c3c3306f394eae9a9
Commit Graph

3 Commits

Author SHA1 Message Date
Ivar Flakstad
3f04a79ada Use cfg to seperate benchmark results based on features 2024-01-07 14:40:15 +01:00
Laurent Mazare
ceb78d3e28 Sketch the minimal mamba example. (#1465) 
* Sketch the minimal mamba example.

* Fix rustfmt.

* Forward pass for mamba.

* Finish the forward pass.

* Inference fixes.

* Bugfixes.

* More fixes.

* Add a readme.
 2023-12-22 00:28:50 +01:00
Nicolas Patry
9b5e4843a6 Optimizing decode matmul (Phi at 28tok/s on M3). 
Adding some benchmark in order to help checking out matmul performance.
 2023-12-20 09:54:19 +01:00