huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
9a62c9164348f4ec9d5bd4c3a40f90758836e570
candle/candle-examples/examples/quantized-qwen2-instruct
History
MaCAT 9ce4fe6194 Fix docs quantized qwen3 (#2955) 
* fixed docs quantized-qwen3 README

* fixed docs quantized-qwen2-instruct README
2025-05-15 07:58:03 +02:00
..
main.rs
Added DeepseekR1 Qwen7B variant to quantized-qwen2-instruct example (#2843)
2025-03-30 10:54:22 +02:00
README.md
Fix docs quantized qwen3 (#2955)
2025-05-15 07:58:03 +02:00

README.md

candle-quantized-qwen2-instruct

Qwen2 is an upgraded version of Qwen1.5, released by Alibaba Cloud.

Running the example

cargo run --example quantized-qwen2-instruct --release -- --prompt "Write a function to count prime numbers up to N."

0.5b, 1.5b, 7b and 72b models are available via --which argument.

 cargo run --release --example quantized-qwen2-instruct --   --which 0.5b   --prompt "Write a function to count prime numbers up to N."