huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 02:38:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a9101700b6f87a66a538a87bb97fa7585a165165
candle/candle-core
History
Laurent Mazare a9101700b6 Add a kv-cache to the quantized llama example. (#466) 
* Add a kv-cache to the quantized llama example.

* Also print the prompt.

* Bugfix in q6k dequantizing.

* Another bugfix.
2023-08-16 14:28:42 +01:00
..
examples
Cudnn support (#445)
2023-08-14 21:30:41 +01:00
src
Add a kv-cache to the quantized llama example. (#466)
2023-08-16 14:28:42 +01:00
tests
Get the ggml based llama to generate some text. (#464)
2023-08-16 12:41:07 +01:00
Cargo.toml
Rename vec-dot to vec-ops. (#449)
2023-08-15 10:48:57 +01:00
LICENSE
Refactor the hierarchy.
2023-06-27 11:57:27 +02:00
README.md
Refactor the hierarchy.
2023-06-27 11:57:27 +02:00

README.md

candle

Minimalist ML framework for Rust