Laurent Mazare af7f8b87d3 Custom op for RmsNorm (#1890) ...

* Trying out a custom RmsNorm cuda kernel.

* CPU implementation for rms-norm.

* Cuda wrappers.

* Add some validation.

* Add some testing.

* More testing.

2024-03-21 06:36:28 +01:00

..

batch_norm.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

group_norm.rs

Move the test-utils bits to a shared place. (#619)

2023-08-27 09:42:22 +01:00

layer_norm.rs

Move the test-utils bits to a shared place. (#619)

2023-08-27 09:42:22 +01:00

loss.rs

Add Binary Cross Entropy With Logit Loss to nn crate (#1157)

2023-10-23 17:12:44 +01:00

one_hot.rs

Add one-hot/cold encoding (#1489)

2024-01-01 11:18:40 +01:00

ops.rs

Custom op for RmsNorm (#1890)

2024-03-21 06:36:28 +01:00

optim.rs

Tweak the VarMap set type. (#1758)

2024-02-25 20:50:08 +01:00

rnn.rs

Add a GRU layer. (#688)

2023-08-31 08:43:10 +01:00