huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 12:20:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,687 Commits 74 Branches 16 Tags
c1876b80415f5b84f3ea07589f359c786035fc5f
Commit Graph

3 Commits

Author SHA1 Message Date
ivarflakstad
9f0c99f0c1 Seperate benchmarks by enabled features (#1538) 
* Use cfg to seperate benchmark results based on features

* Remove allow pragma

* Avoid some unnecessary returns.

* Improve benchmarks layout

* Derive bench_name from actual device

* Run CPU benchmarks even when GPU feature is enabled

---------

Co-authored-by: Laurent <laurent.mazare@gmail.com>
 2024-01-11 15:35:38 +01:00
Laurent Mazare
ceb78d3e28 Sketch the minimal mamba example. (#1465) 
* Sketch the minimal mamba example.

* Fix rustfmt.

* Forward pass for mamba.

* Finish the forward pass.

* Inference fixes.

* Bugfixes.

* More fixes.

* Add a readme.
 2023-12-22 00:28:50 +01:00
Nicolas Patry
9b5e4843a6 Optimizing decode matmul (Phi at 28tok/s on M3). 
Adding some benchmark in order to help checking out matmul performance.
 2023-12-20 09:54:19 +01:00