huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-17 19:18:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

add quantized rwkv v5 model (#1743)

Browse Source 
* and quantized rwkv v5 model

* Integrate the quantized rwkv model in the initial example.

---------

Co-authored-by: laurent <laurent.mazare@gmail.com>
This commit is contained in:
Jack Shih
2024-02-26 04:43:40 +08:00
committed by GitHub
parent 1a6043af51
commit 918136ba46
4 changed files with 326 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
candle-transformers/src/models/mod.rs
View File

@ -30,6 +30,7 @@ pub mod quantized_llama2_c;
pub mod quantized_mistral;
pub mod quantized_mixformer;
pub mod quantized_mpt;
pub mod quantized_rwkv_v5;
pub mod quantized_stable_lm;
pub mod quantized_t5;
pub mod qwen2;