huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,253 Commits 74 Branches 16 Tags
bb3471ea31e637fc02106e1431d4126855ea22e1
Commit Graph

2 Commits

Author SHA1 Message Date
Laurent Mazare
b43ca493f6 Add more quantized flan t5 variants (#923) 
* Add the quantized flan-t5-large variant.

* Add more sizes.
 2023-09-21 13:23:30 +01:00
Laurent Mazare
3b557765e8 T5 quantized example (#922) 
* Load gguf files for the quantized t5.

* Add the quantized t5 example.

* Allow for loading local files.

* Add some support for quantizing safetensor files.

* Transpose before quantizing.

* Quantized t5.

* Retrieve the weights from the hub.
 2023-09-21 12:33:15 +01:00