huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 20:22:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,198 Commits 74 Branches 16 Tags
1a276b5da79a4bb2305dde7368b800d165599819
Commit Graph

1 Commits

Author SHA1 Message Date
Laurent Mazare
1a276b5da7 Add a KV cache to T5. (#873) 
* Add a KV cache to T5.

* Suggest using release mode.

* Use the kv cache in decoding.

* Add a comment.
 2023-09-17 08:00:45 +01:00