mirror of
https://github.com/huggingface/candle.git
synced 2025-06-15 10:26:33 +00:00
b2904a830b
* implemented quantized-gemma, inference not working * Fixed a few modeling bugs: outputing the correct tokens for a few iterations then garbage * lint * clippy * quantized-gemma3 example working * added readme * clippy
405 B
405 B
candle-quantized-gemma
Candle implementation of quantized Gemma.
Running an example
$ cargo run --example quantized-gemma -- --prompt "Write a function to calculate fibonacci numbers. "
> ```python
> def fibonacci(n):
> """Calculates the nth Fibonacci number using recursion."""
> if n <= 1:
> return n
> else:
> return fibonacci(n-1) + fibonacci(n-2
> ```