Files
candle/candle-examples/examples/helium
Laurent Mazare 2653002f29 Gumbel-Softmax sampling. (#2894)
* Gumbel-Softmax sampling.

* Add a sampling test.

* Share the gumbel-softmax bits.
2025-04-14 15:42:42 +02:00
..
2025-04-14 15:42:42 +02:00
2025-01-13 18:04:14 +01:00

candle-helium: 2b LLM with CC-BY licensed weights

Helium-1 is a lightweight model with around 2B parameters, the preview version currently supports 6 languages, showing strong capabilities in those languages compared to existing open weights models.

Running the example

$ cargo run --example helium --release --features cuda -- --prompt 'Write helloworld code in Rust' --sample-len 150