mirror of
https://github.com/huggingface/candle.git
synced 2025-06-16 10:38:54 +00:00
27e70a5093
* [Whisper] Update to use quantized model * [whisper] add language detection * [whisper] change assets location * [whisper] adapt js example with quantized models * [whisper] better task parsing * [whisper] minor fixes
69 lines
2.7 KiB
Markdown
69 lines
2.7 KiB
Markdown
## Running Whisper Examples
|
|
|
|
Here, we provide two examples of how to run Whisper using a Candle-compiled WASM binary and runtimes.
|
|
|
|
### Pure Rust UI
|
|
|
|
To build and test the UI made in Rust you will need [Trunk](https://trunkrs.dev/#install)
|
|
From the `candle-wasm-examples/whisper` directory run:
|
|
|
|
Download assets:
|
|
|
|
```bash
|
|
# mel filters
|
|
wget -c https://huggingface.co/spaces/lmz/candle-whisper/resolve/main/mel_filters.safetensors
|
|
# Model and tokenizer tiny.en
|
|
wget -c https://huggingface.co/openai/whisper-tiny.en/resolve/main/model.safetensors -P whisper-tiny.en
|
|
wget -c https://huggingface.co/openai/whisper-tiny.en/raw/main/tokenizer.json -P whisper-tiny.en
|
|
wget -c https://huggingface.co/openai/whisper-tiny.en/raw/main/config.json -P whisper-tiny.en
|
|
# model and tokenizer tiny multilanguage
|
|
wget -c https://huggingface.co/openai/whisper-tiny/resolve/main/model.safetensors -P whisper-tiny
|
|
wget -c https://huggingface.co/openai/whisper-tiny/raw/main/tokenizer.json -P whisper-tiny
|
|
wget -c https://huggingface.co/openai/whisper-tiny/raw/main/config.json -P whisper-tiny
|
|
|
|
#quantized
|
|
wget -c https://huggingface.co/lmz/candle-whisper/resolve/main/model-tiny-en-q80.gguf -P quantized
|
|
wget -c https://huggingface.co/lmz/candle-whisper/raw/main/tokenizer-tiny-en.json -P quantized
|
|
wget -c https://huggingface.co/lmz/candle-whisper/raw/main/config-tiny-en.json -P quantized
|
|
|
|
|
|
|
|
# Audio samples
|
|
wget -c https://huggingface.co/datasets/Narsil/candle-examples/resolve/main/samples_gb0.wav -P audios
|
|
wget -c https://huggingface.co/datasets/Narsil/candle-examples/resolve/main/samples_a13.wav -P audios
|
|
wget -c https://huggingface.co/datasets/Narsil/candle-examples/resolve/main/samples_gb1.wav -P audios
|
|
wget -c https://huggingface.co/datasets/Narsil/candle-examples/resolve/main/samples_hp0.wav -P audios
|
|
wget -c https://huggingface.co/datasets/Narsil/candle-examples/resolve/main/samples_jfk.wav -P audios
|
|
wget -c https://huggingface.co/datasets/Narsil/candle-examples/resolve/main/samples_mm0.wav -P audios
|
|
|
|
```
|
|
|
|
Run hot reload server:
|
|
|
|
```bash
|
|
trunk serve --release --public-url / --port 8080
|
|
```
|
|
|
|
### Vanilla JS and WebWorkers
|
|
|
|
To build and test the UI made in Vanilla JS and WebWorkers, first we need to build the WASM library:
|
|
|
|
```bash
|
|
sh build-lib.sh
|
|
```
|
|
|
|
This will bundle the library under `./build` and we can import it inside our WebWorker like a normal JS module:
|
|
|
|
```js
|
|
import init, { Decoder } from "./build/m.js";
|
|
```
|
|
|
|
The full example can be found under `./lib-example.html`. All needed assets are fetched from the web, so no need to download anything.
|
|
Finally, you can preview the example by running a local HTTP server. For example:
|
|
|
|
```bash
|
|
python -m http.server
|
|
```
|
|
|
|
Then open `http://localhost:8000/lib-example.html` in your browser.
|