Files
candle/candle-examples/examples
Santiago Medina ea0d8d3753 Quantized moondream implementation and BOS token (#1980)
* moondream implementation

* add moondream example

* change config default activation

* Add assets and integrate phi mixformer with example

* Make use of kv cache and fix seq_len bug; Clean up example code

* Add README link to example

* Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig

* Delete image

* Use apply instead of forward

* Pass bos token at the beginning of tensor.

* Quantize moondream.

* Forward with image bos token.

* Clippy.

* Use q4_0 quantization.

* Add pointers for sequence and tokens; Remove seq_len conditional
2024-04-01 19:37:54 +02:00
..
2024-01-17 10:27:58 +01:00
2024-02-09 17:36:50 +01:00
2023-11-24 15:09:14 +00:00
2024-03-13 21:41:36 +01:00
2024-02-22 10:22:03 +01:00
2024-01-17 10:27:58 +01:00
2024-03-28 23:24:46 +01:00
2024-01-17 10:27:58 +01:00
2024-03-09 11:21:48 +01:00
2024-02-10 16:14:50 +01:00
2024-03-21 12:54:09 +01:00