huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 19:47:12 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a9101700b6f87a66a538a87bb97fa7585a165165
candle/candle-examples/examples/ggml
History
Laurent Mazare a9101700b6 Add a kv-cache to the quantized llama example. (#466) 
* Add a kv-cache to the quantized llama example.

* Also print the prompt.

* Bugfix in q6k dequantizing.

* Another bugfix.
2023-08-16 14:28:42 +01:00
..
main.rs
Add a kv-cache to the quantized llama example. (#466)
2023-08-16 14:28:42 +01:00