huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-17 19:18:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
666 Commits 74 Branches 16 Tags
a0e47aba987dfd38b7fefc5639df58e1fb49dafc
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
3eb2bc6d07 Softmax numerical stability. (#267) 
* Softmax numerical stability.

* Fix the flash-attn test.
 2023-07-28 13:13:01 +01:00
Laurent Mazare
550a13a547 Use the binary decoder for llama2.c. (#230) 
* Use the binary decoder for llama2.c.

* Add the temperature.

* Formatting tweak.

* Fix the rotary embeddings.
 2023-07-24 10:56:08 +01:00
Laurent Mazare
35b65fed88 Add llama2.c as an example. (#229) 
* Start adding llama2.c.

* Model loading.

* Add the llama-v2 model.

* Start converting the weights.

* Rotary embedding tweaks.

* Get the model to generate some tokens.
 2023-07-24 09:13:50 +01:00