Laurent Mazare 0902846f25 Add the AdamW optimizer. (#307) ...

* Add the AdamW optimizer.

* Add some AdamW test validated against PyTorch.

2023-08-02 14:03:49 +01:00

..

vision

Vision dataset (#179)

2023-07-16 23:43:55 +01:00

activation.rs

[nn] Move the Embedding and Activation parts. (#116)

2023-07-10 10:24:52 +01:00

conv.rs

Rename the .r functions to .dims so as to be a bit more explicit. (#220)

2023-07-22 10:39:27 +01:00

dataset.rs

Add some batcher variants that handle errors. (#294)

2023-08-01 09:40:34 +01:00

embedding.rs

Use index-select for the embeddings as it supports backprop. (#298)

2023-08-01 20:44:43 +01:00

init.rs

Improve the mnist training example. (#276)

2023-07-29 16:28:22 +01:00

layer_norm.rs

Llama more training (#297)

2023-08-01 19:53:41 +01:00

lib.rs

Add the AdamW optimizer. (#307)

2023-08-02 14:03:49 +01:00

linear.rs

Llama more training (#297)

2023-08-01 19:53:41 +01:00

loss.rs

Add the cross-entropy loss. (#287)

2023-07-31 14:26:36 +01:00

ops.rs

Softmax numerical stability. (#267)

2023-07-28 13:13:01 +01:00

optim.rs

Add the AdamW optimizer. (#307)

2023-08-02 14:03:49 +01:00

var_builder.rs

Llama more training (#297)

2023-08-01 19:53:41 +01:00