5 Commits

Author	SHA1	Message	Date
Juarez Bochi	3e49f8fce5	Implement T5 decoding (#864) ... * Load t5 decoder * Run enc, dec, and lm head, but no cross attn * Cross-attention over key_value_states * New arg for decoder input ids * Add mask, don't forward position biases through decoder * Update t5 examples * Clippy + rustfmt	2023-09-15 22:05:12 +02:00
Laurent Mazare	31ab2ddaeb	Remove the padding. (#838)	2023-09-13 13:00:59 +01:00
Laurent Mazare	3e94324012	Add some sentence similarity part to the t5 example. (#835) ... * Add some sentence similarity part to the t5 example. * Clippy fix.	2023-09-13 10:44:02 +01:00
Laurent Mazare	e4553fb355	T5 tweaks (#831) ... * Use default values rather than options. * Avoid exposing the device field. * More tweaks.	2023-09-13 07:37:04 +01:00
Juarez Bochi	9daa6dbe87	Extract T5 module and add main function to use it (#829) ... * Extract t5 out of musicgen * Add main for t5 module	2023-09-13 07:14:05 +01:00