mirror of
https://github.com/huggingface/candle.git
synced 2025-06-15 10:26:33 +00:00
918136ba46
* and quantized rwkv v5 model * Integrate the quantized rwkv model in the initial example. --------- Co-authored-by: laurent <laurent.mazare@gmail.com>
candle-rwkv
The RWKV model is a recurrent neural network model with performance on par with transformer architectures. Several variants are available, candle implements the v5 version and can be used with Eagle 7B(blog post).
$ cargo run --example rwkv --release -- --prompt "The smallest prime is "
avx: true, neon: false, simd128: false, f16c: true
temp: 0.00 repeat-penalty: 1.10 repeat-last-n: 64
The smallest prime is ϕ(2) = 2.
The smallest composite is ϕ(3) = 3.
The smallest perfect number is ϕ(5) = 5.
The smallest perfect square is ϕ(4) = 4.
The smallest perfect cube is ϕ(6) = 6.