huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 18:28:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
b4daa03e598b516ee4dca5864b70f7254642b7bd
candle/candle-examples/examples/siglip
History
Laurent Mazare e286cf7cc9 Parse the json config for siglip models. (#2800) 
* Parse the json config for siglip models.

* Bump the tokenizers dependency.

* Add a v2 model.

* Support more v2 model.s
2025-03-09 14:01:09 +01:00
..
main.rs
Parse the json config for siglip models. (#2800)
2025-03-09 14:01:09 +01:00
README.md
Add the SigLIP model. (#2515)
2024-09-28 23:48:00 +02:00

README.md

SigLIP

SigLIP is multi-modal text-vision model that improves over CLIP by using a sigmoid based loss, HuggingFace.

Running an example

$ cargo run --features cuda -r --example siglip -
softmax_image_vec: [2.1912122e-14, 2.3624872e-14, 1.0, 1.0, 2.4787932e-8, 3.2784535e-12]


Results for image: candle-examples/examples/stable-diffusion/assets/stable-diffusion-xl.jpg

Probability: 0.0000% Text: a cycling race 
Probability: 0.0000% Text: a photo of two cats 
Probability: 100.0000% Text: a robot holding a candle 


Results for image: candle-examples/examples/yolo-v8/assets/bike.jpg

Probability: 100.0000% Text: a cycling race 
Probability: 0.0000% Text: a photo of two cats 
Probability: 0.0000% Text: a robot holding a candle