6 Commits

Author	SHA1	Message	Date
Laurent Mazare	c87381fc96	Use F16 for moondream on cuda. (#2013)	2024-04-04 23:30:10 +02:00
Santiago Medina	d17b2cdad9	Match Moondream's latest release (#1997) ... * moondream implementation * add moondream example * change config default activation * Add assets and integrate phi mixformer with example * Make use of kv cache and fix seq_len bug; Clean up example code * Add README link to example * Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig * Delete image * Use apply instead of forward * Use latest release special token; Fix token/s accuracy; Use GeluPytorchTanh in VisionConfig v2	2024-04-02 21:37:09 +02:00
Santiago Medina	ea0d8d3753	Quantized moondream implementation and BOS token (#1980) ... * moondream implementation * add moondream example * change config default activation * Add assets and integrate phi mixformer with example * Make use of kv cache and fix seq_len bug; Clean up example code * Add README link to example * Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig * Delete image * Use apply instead of forward * Pass bos token at the beginning of tensor. * Quantize moondream. * Forward with image bos token. * Clippy. * Use q4_0 quantization. * Add pointers for sequence and tokens; Remove seq_len conditional	2024-04-01 19:37:54 +02:00
Laurent Mazare	f9954b73ba	Add options to use local files + specify a custom repo or branch. (#1973)	2024-03-31 09:32:50 +02:00
Laurent Mazare	eead1dcead	Clippy fix. (#1972)	2024-03-31 08:57:40 +02:00
Santiago Medina	92f81d2fcb	Add Moondream transformer implementation and example (#1970) ... * moondream implementation * add moondream example * change config default activation * Add assets and integrate phi mixformer with example * Make use of kv cache and fix seq_len bug; Clean up example code * Add README link to example * Remove pos_embed scaling; Remove assets; Add to README; Expand VisionConfig * Delete image * Use apply instead of forward	2024-03-31 08:54:56 +02:00