Files
candle/candle-examples/examples/gte-qwen
..

gte-Qwen1.5-7B-instruct

gte-Qwen1.5-7B-instruct is a variant of the GTE embedding model family.

Running the example

Automatically download the model from the HuggingFace hub:

$ cargo run --example gte-qwen --release

or, load the model from a local directory:

cargo run --example gte-qwen --release --features cuda -- --local-repo /path/to/gte_Qwen1.5-7B-instruct/