huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 19:47:12 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add an abstract type for RmsNorm. (#499)

Browse Source
This commit is contained in:
Laurent Mazare
2023-08-18 08:52:14 +01:00
committed by GitHub
parent a22b1bed7b
commit 13401df4d1
8 changed files with 45 additions and 24 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
candle-examples/examples/llama/model.rs
View File

@ -152,7 +152,7 @@ fn embedding(cfg: &Config, vb: VarBuilder) -> Result<Embedding> {
}
struct RmsNorm {
inner: candle_nn::LayerNorm,
inner: candle_nn::RmsNorm,
span: tracing::Span,
}