huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 18:28:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
34cb9f924fb2eba0ee2a206b47854e5d49d2f22d
candle/candle-examples
History
Laurent Mazare f9ecc84477 GQA support in the quantized model. (#555) 
* GQA support in the quantized model.

* Fix the reshaping.

* Fix the main llama model.

* Infer the proper gqa from the model kind.
2023-08-22 19:41:10 +01:00
..
examples
GQA support in the quantized model. (#555)
2023-08-22 19:41:10 +01:00
src
Move the yolo shared bits to a common place. (#548)
2023-08-22 13:03:07 +01:00
build.rs
Add flash attention (#241)
2023-07-26 07:48:10 +01:00
Cargo.toml
Bump the crates version to 0.1.2. (#522)
2023-08-20 08:07:07 +01:00
README.md
Add some missing readme files. (#304)
2023-08-02 10:57:12 +01:00

README.md

candle-examples