huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 19:47:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,282 Commits 74 Branches 16 Tags
ada8851a23bcddccbc5bc6e972b020401a1fe389
Commit Graph

1 Commits

Author SHA1 Message Date
Laurent Mazare
3b557765e8 T5 quantized example (#922) 
* Load gguf files for the quantized t5.

* Add the quantized t5 example.

* Allow for loading local files.

* Add some support for quantizing safetensor files.

* Transpose before quantizing.

* Quantized t5.

* Retrieve the weights from the hub.
 2023-09-21 12:33:15 +01:00