huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 10:26:33 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
12d6dc018dc7c0c698162cb19e9459bb915c5b84
candle/candle-examples/examples/llama
History
Laurent Mazare 12d6dc018d Support for MQA for llama v2. (#205) 
* Support for MQA for llama v2.

* More llama-v2.

* Move the rotary embedding precomputation in the cache.

* Add a v2 flag.

* Use the hf model.
2023-07-20 06:39:04 +01:00
..
convert_checkpoint.py
Resurrect the llama npy support. (#140)
2023-07-11 19:32:10 +01:00
main.rs
Support for MQA for llama v2. (#205)
2023-07-20 06:39:04 +01:00
model.rs
Support for MQA for llama v2. (#205)
2023-07-20 06:39:04 +01:00