Add the AdamW optimizer. (#307)

* Add the AdamW optimizer.

* Add some AdamW test validated against PyTorch.
This commit is contained in:
Laurent Mazare
2023-08-02 14:03:49 +01:00
committed by GitHub
parent e2acbe1e72
commit 0902846f25
6 changed files with 216 additions and 19 deletions

View File

@ -34,7 +34,7 @@
//! Rust is cool, and a lot of the HF ecosystem already has Rust crates [safetensors](https://github.com/huggingface/safetensors) and [tokenizers](https://github.com/huggingface/tokenizers)
pub mod backend;
mod backprop;
pub mod backprop;
mod conv;
mod convert;
pub mod cpu_backend;