5 Commits

Author	SHA1	Message	Date
Laurent Mazare	2d5f2a728d	Add the RWKV model (v5). (#1707) ... * Start adding the RWKV model. * More of the forward step. * Handle rescaling. * FeedForward. * More work on RWKV. * Better state tracking. * Finish a first pass on forward. * Fix the shape mismatches. * Do not rescale in f32. * Rename to rwkv-v5. * Add the new models to the readme.	2024-02-14 10:58:32 +01:00
Daniel Clough	58cc896e69	make llama derive clone (#1648) ... Co-authored-by: danielclough <danielclough@users.noreply.github.com>	2024-02-04 11:56:03 +01:00
Jani Monoses	63944714f2	Use candle_nn::embedding instead of local copies in a few models. (#1562)	2024-01-10 21:36:27 +01:00
Laurent Mazare	1704f1b3ae	Consolidate the with-tracing usage. (#1234)	2023-11-01 18:21:36 +00:00
Laurent Mazare	d3f05eae8c	Move some models to candle-transformers so that it's easier to re-use. (#794) ... * Move some models to candle-transformers so that they can be shared. * Also move falcon. * Move Llama. * Move whisper (partial).	2023-09-10 09:40:27 +01:00