huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add the MPT model. (#1114)

Browse Source 
* Add the MPT model.

* Add ffn and block.

* Forward pass for the mpt block.

* Repeat-kv.
This commit is contained in:
Laurent Mazare
2023-10-17 16:06:48 +01:00
committed by GitHub
parent f9e93f5b69
commit 872c3f14b0
2 changed files with 203 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
candle-transformers/src/models/mod.rs
View File

@ -7,6 +7,7 @@ pub mod falcon;
pub mod llama;
pub mod mistral;
pub mod mixformer;
pub mod mpt;
pub mod quantized_llama;
pub mod quantized_mistral;
pub mod quantized_mixformer;