[nn] Move the Embedding and Activation parts. (#116)

* Share the Embedding and Activation parts.

* Tweak some activations.
This commit is contained in:
Laurent Mazare
2023-07-10 10:24:52 +01:00
committed by GitHub
parent 9ce0f1c010
commit b06e1a7e54
9 changed files with 91 additions and 149 deletions

View File

@ -1,5 +1,11 @@
// For now this crate shares its error type with candle-core. We may introduce some separate
// error type if needed or add some specialized cases on the candle-core side.
mod activation;
mod embedding;
mod layer_norm;
mod linear;
pub use activation::Activation;
pub use embedding::Embedding;
pub use layer_norm::LayerNorm;
pub use linear::Linear;