mirror of
https://github.com/huggingface/candle.git
synced 2025-06-16 02:38:10 +00:00
29bd6b2979
* add phi wasm module * replace input with textarea * trim input prompt * stop on <|endoftext|> * formatting * clean up * add blurb, and syntax highlighting * add phi-v1.5 wasm * add note * hide Options on details * add first token to generated text * whitespaces for new line * fix: abort -> aborted
27 lines
893 B
Markdown
27 lines
893 B
Markdown
## Running [Microsoft phi 1.5](https://huggingface.co/microsoft/phi-1_5) Example
|
|
|
|
Here, we provide two examples of how to run [Microsoft phi 1.5](https://huggingface.co/microsoft/phi-1_5) written in Rust using a Candle-compiled WASM binary and runtime.
|
|
|
|
### Vanilla JS and WebWorkers
|
|
|
|
To build and test the UI made in Vanilla JS and WebWorkers, first we need to build the WASM library:
|
|
|
|
```bash
|
|
sh build-lib.sh
|
|
```
|
|
|
|
This will bundle the library under `./build` and we can import it inside our WebWorker like a normal JS module:
|
|
|
|
```js
|
|
import init, { Model } from "./build/m.js";
|
|
```
|
|
|
|
The full example can be found under `./index.html`. All needed assets are fetched from the web, so no need to download anything.
|
|
Finally, you can preview the example by running a local HTTP server. For example:
|
|
|
|
```bash
|
|
python -m http.server
|
|
```
|
|
|
|
Then open `http://localhost:8000/index.html` in your browser.
|