huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update README + SAM (#866)

Browse Source 
* use serde-wasm-bindgen, faster serialization

* update readme with demos
This commit is contained in:
Radamés Ajna
2023-09-15 22:34:13 -07:00
committed by GitHub
parent 635012d770
commit 04ca2b9ebd
4 changed files with 7 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -50,6 +50,7 @@ These online demos run entirely in your browser:
object recognition. object recognition.
- [whisper](https://huggingface.co/spaces/lmz/candle-whisper): text to speech. - [whisper](https://huggingface.co/spaces/lmz/candle-whisper): text to speech.
- [LLaMA2](https://huggingface.co/spaces/lmz/candle-llama2): text generation. - [LLaMA2](https://huggingface.co/spaces/lmz/candle-llama2): text generation.
- [Segment Anything Model](https://huggingface.co/spaces/radames/candle-segment-anything-wasm): Image segmentation.
We also provide a some command line based examples using state of the art models: We also provide a some command line based examples using state of the art models:
@ -96,7 +97,8 @@ There are also some wasm examples for whisper and
[llama2.c](https://github.com/karpathy/llama2.c). You can either build them with [llama2.c](https://github.com/karpathy/llama2.c). You can either build them with
`trunk` or try them online: `trunk` or try them online:
[whisper](https://huggingface.co/spaces/lmz/candle-whisper), [whisper](https://huggingface.co/spaces/lmz/candle-whisper),
[llama2](https://huggingface.co/spaces/lmz/candle-llama2). [llama2](https://huggingface.co/spaces/lmz/candle-llama2),
[Segment Anything Model](https://huggingface.co/spaces/radames/candle-segment-anything-wasm).
For LLaMA2, run the following command to retrieve the weight files and start a For LLaMA2, run the following command to retrieve the weight files and start a
test server: test server:

1
candle-wasm-examples/segment-anything/Cargo.toml
View File

@ -27,3 +27,4 @@ serde_json = { workspace = true }
# Wasm specific crates. # Wasm specific crates.
console_error_panic_hook = "0.1.7" console_error_panic_hook = "0.1.7"
wasm-bindgen = "0.2.87" wasm-bindgen = "0.2.87"
serde-wasm-bindgen = "0.6.0"

3
candle-wasm-examples/segment-anything/samWorker.js
View File

@ -141,8 +141,7 @@ self.addEventListener("message", async (event) => {
} }
self.postMessage({ status: "segmenting", message: "Segmenting" }); self.postMessage({ status: "segmenting", message: "Segmenting" });
const result = sam.mask_for_point(points.x, points.y); const { mask, image } = sam.mask_for_point(points.x, points.y);
const { mask, image } = JSON.parse(result);
const maskDataURL = await createImageCanvas(mask, image); const maskDataURL = await createImageCanvas(mask, image);
// Send the segment back to the main thread as JSON // Send the segment back to the main thread as JSON
self.postMessage({ self.postMessage({

5
candle-wasm-examples/segment-anything/src/bin/m.rs
View File

@ -76,7 +76,7 @@ impl Model {
} }
// x and y have to be between 0 and 1 // x and y have to be between 0 and 1
pub fn mask_for_point(&self, x: f64, y: f64) -> Result<String, JsError> { pub fn mask_for_point(&self, x: f64, y: f64) -> Result<JsValue, JsError> {
if !(0. ..=1.).contains(&x) { if !(0. ..=1.).contains(&x) {
Err(JsError::new(&format!( Err(JsError::new(&format!(
"x has to be between 0 and 1, got {x}" "x has to be between 0 and 1, got {x}"
@ -112,8 +112,7 @@ impl Model {
width: embeddings.width, width: embeddings.width,
height: embeddings.height, height: embeddings.height,
}; };
let json = serde_json::to_string(&MaskImage { mask, image })?; Ok(serde_wasm_bindgen::to_value(&MaskImage { mask, image })?)
Ok(json)
} }
} }