huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-19 19:58:35 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add the AdamW optimizer. (#307)

Browse Source 
* Add the AdamW optimizer.

* Add some AdamW test validated against PyTorch.
This commit is contained in:
Laurent Mazare
2023-08-02 14:03:49 +01:00
committed by GitHub
parent e2acbe1e72
commit 0902846f25
6 changed files with 216 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
candle-nn/src/lib.rs
View File

@ -19,5 +19,5 @@ pub use embedding::{embedding, Embedding};
pub use init::Init;
pub use layer_norm::{layer_norm, LayerNorm};
pub use linear::{linear, linear_no_bias, Linear};
pub use optim::SGD;
pub use optim::{AdamW, ParamsAdamW, SGD};
pub use var_builder::{VarBuilder, VarMap};