huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 02:38:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
metal-fp8-fun
candle/candle-examples/examples/helium
History
Laurent Mazare 27996a1a9e Remove the old MFA gemm kernels. (#2742) 
* Remove the old MFA gemm kernels.

* Use bf16 in helium on metal.
2025-01-26 20:36:31 +01:00
..
main.rs
Remove the old MFA gemm kernels. (#2742)
2025-01-26 20:36:31 +01:00
README.md
Helium repo update. (#2716)
2025-01-13 18:04:14 +01:00

README.md

candle-helium: 2b LLM with CC-BY licensed weights

Helium-1 is a lightweight model with around 2B parameters, the preview version currently supports 6 languages, showing strong capabilities in those languages compared to existing open weights models.

Running the example

$ cargo run --example helium --release --features cuda -- --prompt 'Write helloworld code in Rust' --sample-len 150