huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3b557765e8e1641d1289d33b177938abe10d24d2
candle/candle-transformers
History
Laurent Mazare 3b557765e8 T5 quantized example (#922) 
* Load gguf files for the quantized t5.

* Add the quantized t5 example.

* Allow for loading local files.

* Add some support for quantizing safetensor files.

* Transpose before quantizing.

* Quantized t5.

* Retrieve the weights from the hub.
2023-09-21 12:33:15 +01:00
..
src
T5 quantized example (#922)
2023-09-21 12:33:15 +01:00
tests
Implement top_p / nucleus sampling (#819)
2023-09-12 18:10:16 +02:00
Cargo.toml
Add flash-attn support. (#912)
2023-09-20 14:07:55 +01:00
README.md
Add some missing readme files. (#304)
2023-08-02 10:57:12 +01:00

README.md

candle-transformers