4 Commits

Author	SHA1	Message	Date
Laurent Mazare	2e5fb0b251	Do not use the kv-cache on external key-value states. (#1054)	2023-10-07 22:37:19 +01:00
Juarez Bochi	3349c89252	Add quantized t5 args for weight and config (#1029)	2023-10-04 17:02:49 +01:00
Laurent Mazare	b43ca493f6	Add more quantized flan t5 variants (#923) ... * Add the quantized flan-t5-large variant. * Add more sizes.	2023-09-21 13:23:30 +01:00
Laurent Mazare	3b557765e8	T5 quantized example (#922) ... * Load gguf files for the quantized t5. * Add the quantized t5 example. * Allow for loading local files. * Add some support for quantizing safetensor files. * Transpose before quantizing. * Quantized t5. * Retrieve the weights from the hub.	2023-09-21 12:33:15 +01:00