huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 12:20:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
989 Commits 74 Branches 16 Tags
b23b347b35a246cb03395cc9cdf1bf0e867862a0
Commit Graph

8 Commits

Author SHA1 Message Date
Laurent Mazare
aba1e90797 Add some group parameter to convolutions. (#566) 
* Add some group parameter to convolutions.

* Avoid some unnecessary groups checks.

* Move the tensor convolution bits.

* Properh handling of groups.

* Bump the crate version.

* And add a changelog.
 2023-08-23 12:58:55 +01:00
Laurent Mazare
c78ce76501 Add a simple Module trait and implement it for the various nn layers (#500) 
* Start adding the module trait.

* Use the module trait.

* Implement module for qmatmul.
 2023-08-18 09:38:22 +01:00
Laurent Mazare
c84883ecf2 Add a cuda kernel for upsampling. (#441) 
* Add a cuda kernel for upsampling.

* Update for the latest tokenizers version.
 2023-08-14 13:12:17 +01:00
Laurent Mazare
3eb2bc6d07 Softmax numerical stability. (#267) 
* Softmax numerical stability.

* Fix the flash-attn test.
 2023-07-28 13:13:01 +01:00
Nicolas Patry
1735e4831e TP sharding v2 2023-07-27 09:58:14 +02:00
Laurent Mazare
209f06d7c3 Micro-cleanup. (#256) 2023-07-27 07:55:54 +01:00
Nicolas Patry
035372248e Simple QOL. 
- Add ms/token on llama2.c (15ms/token on my personal machine)
- Hide `Run` buttons while models are not ready
- Add dummy `progress` while weights are downloading (I briefly looked
  at putting a real progressbar.. and nothing easy enough came up.)
 2023-07-26 15:17:32 +02:00
Laurent Mazare
5a26cba733 Re-organize the wasm examples (#231) 
* Move the whisper example.

* More renaming.

* Add llama2 as a new wasm example.

* Live generation.

* More of the llama wasm example.

* Formatting.
 2023-07-24 12:36:02 +01:00