huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-19 11:56:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

Derive clone and debug traits for Moondream model (#2100)

Browse Source 
* moondream implementation

* add moondream example

* change config default activation

* Add assets and integrate phi mixformer with example

* Make use of kv cache and fix seq_len bug; Clean up example code

* Add README link to example

* Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig

* Delete image

* Use apply instead of forward

* Use latest release special token; Fix token/s accuracy; Use GeluPytorchTanh in VisionConfig v2

* Derive debug and clone traits for Moondream model.
This commit is contained in:
Santiago Medina
2024-04-20 22:08:28 -07:00
committed by GitHub
parent 0067fe00a8
commit d22f1d4f4e
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
candle-transformers/src/models/moondream.rs
View File

@ -302,6 +302,7 @@ impl Module for VisionEncoder {
} }
} }
#[derive(Debug, Clone)]
pub struct Model { pub struct Model {
pub text_model: PhiModel, pub text_model: PhiModel,
pub vision_encoder: VisionEncoder, pub vision_encoder: VisionEncoder,