Laurent Mazare d01207dbf3 Add a RotatingKVCache. (#2493) ...

* Add a RotatingKVCache.

* Add some KvCache tests.

* Test the reset too.

* More kv-cache testing.

* More tests for the rotating kv-cache.

* Improve the api for the rotating cache so that the whole src tensor gets returned when it's overlarge.

* Handle contiguity + bugfix + use in mimi.

* Add a way to test the mimi streaming mode.

* Mimi streaming fixes.

* More rotating kv-cache.

* Fix the attn mask generation.

* Handle the abs case.

* Add some tests for the generated mask.

2024-09-23 13:14:32 +02:00

..

activation.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

batch_norm.rs

Detach the tensors on batch-norm eval. (#1702)

2024-02-13 14:26:32 +01:00

conv.rs

Bugfix for applying the bias in conv1d-transpose. (#1732)

2024-02-18 22:51:20 +01:00

embedding.rs

Add clone to various nn layers. (#910)

2023-09-20 11:33:51 +01:00

encoding.rs

Fix clippy lints for 1.76. (#1682)

2024-02-08 16:48:47 +01:00

func.rs

Allow for different behavior between training and eval (#1213)

2023-10-29 07:53:09 +01:00

group_norm.rs

Add clone to various nn layers. (#910)

2023-09-20 11:33:51 +01:00

init.rs

VarBuilder cleanup (#627)

2023-08-27 18:03:26 +01:00

kv_cache.rs

Add a RotatingKVCache. (#2493)

2024-09-23 13:14:32 +02:00

layer_norm.rs

Enable the new layer-norm. (#2213)

2024-05-24 16:48:21 +02:00

lib.rs

Add a slice_set op. (#2193)

2024-05-18 15:58:18 +02:00

linear.rs

Support for attention bias in gemma + refactor things a bit. (#1744)

2024-02-22 09:35:28 +01:00

loss.rs

Add Binary Cross Entropy With Logit Loss to nn crate (#1157)

2023-10-23 17:12:44 +01:00

ops.rs

Depth Anything v2 (#2279)

2024-06-24 19:12:52 +02:00

optim.rs

Expose AdamW parameters (#1449)

2023-12-16 18:41:56 -06:00

rnn.rs

onnx: implement LSTM op (#2268)

2024-08-19 09:06:17 +02:00

rotary_emb.rs

Add the rope THD kernel. (#2014)

2024-04-05 08:32:58 +02:00

sequential.rs

Make func cloneable. (#1137)

2023-10-20 16:28:50 +01:00

var_builder.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

var_map.rs

Tweak the VarMap set type. (#1758)

2024-02-25 20:50:08 +01:00