huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
849 Commits 74 Branches 16 Tags
3cc87058b7dcd73a723cd6375861743f535c0e21
Commit Graph

1 Commits

Author SHA1 Message Date
Lukas Kreussel
9e7e6e0288 Add dequantization for ggmls q4_0, q4_1, q5_0, q5_1 and q8_0 (#407) 
* Added dequantization for `q4_0`, `q4_1`, `q5_0`, `q5_1` and `q8_0`

* expose `tensor_from_ggml` for external usage

* bugfixes & example
 2023-08-13 23:22:57 +01:00