huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a9101700b6f87a66a538a87bb97fa7585a165165
candle/candle-examples
History
Laurent Mazare a9101700b6 Add a kv-cache to the quantized llama example. (#466) 
* Add a kv-cache to the quantized llama example.

* Also print the prompt.

* Bugfix in q6k dequantizing.

* Another bugfix.
2023-08-16 14:28:42 +01:00
..
examples
Add a kv-cache to the quantized llama example. (#466)
2023-08-16 14:28:42 +01:00
src
Typos and format and CD only when PR lands.
2023-08-02 19:18:43 +02:00
build.rs
Add flash attention (#241)
2023-07-26 07:48:10 +01:00
Cargo.toml
Rename vec-dot to vec-ops. (#449)
2023-08-15 10:48:57 +01:00
README.md
Add some missing readme files. (#304)
2023-08-02 10:57:12 +01:00

README.md

candle-examples