huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 03:28:50 +00:00
Code Issues Packages Projects Releases Wiki Activity
710 Commits 74 Branches 16 Tags
ff876c2103bc530f9ba3bc278c5e09148c124885
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
ff876c2103 Llama more training (#297) 
* Rework the var-builder to handle initializations.

* Add some helper functions for layer creation.

* Improve the layer initializations.

* Get initialized variables.

* Precompute the rot embeddings when training lamas.
 2023-08-01 19:53:41 +01:00
Laurent Mazare
465fc8c0c5 Add some documentation and test to the linear layer. (#151) 
* Add some documentation and test to the linear layer.

* Layer norm doc.

* Minor tweaks.
 2023-07-12 20:24:23 +01:00
Laurent Mazare
b06e1a7e54 [nn] Move the Embedding and Activation parts. (#116) 
* Share the Embedding and Activation parts.

* Tweak some activations.
 2023-07-10 10:24:52 +01:00