8 Commits

Author	SHA1	Message	Date
drbh	13c67226e6	feat: support microphone whisper streaming (#1678) ... * feat: support microphone whisper streaming * fix: cleanup print stmts and adjust how input is read * fix: remove incorrect comment * feat: split into new example and simplify * fix: feature flag example file * fix: fmt fixes * feat: simplify and remove redundant files	2024-02-12 18:01:21 +01:00
drbh	9cadd4e644	feat: support multithread spectrogram and small perf tweaks (#1674) ... * feat: support multithread spectrogram and small perf tweaks * feat: clippy improvement for loop variable * fix: add back speed up scale down logic * fix: readd mirroring logic * feat: prefer scoped thread and simplify/improve logic/traits	2024-02-08 21:54:12 +01:00
Jani Monoses	63944714f2	Use candle_nn::embedding instead of local copies in a few models. (#1562)	2024-01-10 21:36:27 +01:00
Laurent Mazare	1704f1b3ae	Consolidate the with-tracing usage. (#1234)	2023-11-01 18:21:36 +00:00
Laurent Mazare	85bea43e5b	Make the whisper model cloneable (#1200) ... * Add a quantized variant of llama2.c * Clippy fixes. * Make the whisper model cloneable.	2023-10-27 16:59:19 +01:00
Laurent Mazare	e04c789230	Add a quantized variant of whisper (#1017) ... * Add the quantized-whisper model. * Quantized the whisper model. * Adapt the whisper example to handle quantization. * Add the quantized flag. * Load the proper weights.	2023-10-02 14:59:53 +01:00
Laurent Mazare	84ee870efd	Use softmax-last-dim in whisper. (#810)	2023-09-11 11:05:05 +01:00
Laurent Mazare	d3f05eae8c	Move some models to candle-transformers so that it's easier to re-use. (#794) ... * Move some models to candle-transformers so that they can be shared. * Also move falcon. * Move Llama. * Move whisper (partial).	2023-09-10 09:40:27 +01:00