mirror of
https://github.com/huggingface/candle.git
synced 2025-06-18 11:37:11 +00:00
b2904a830b
* implemented quantized-gemma, inference not working * Fixed a few modeling bugs: outputing the correct tokens for a few iterations then garbage * lint * clippy * quantized-gemma3 example working * added readme * clippy
18 lines
405 B
Markdown
18 lines
405 B
Markdown
# candle-quantized-gemma
|
|
|
|
Candle implementation of quantized Gemma.
|
|
|
|
## Running an example
|
|
|
|
```bash
|
|
$ cargo run --example quantized-gemma -- --prompt "Write a function to calculate fibonacci numbers. "
|
|
|
|
> ```python
|
|
> def fibonacci(n):
|
|
> """Calculates the nth Fibonacci number using recursion."""
|
|
> if n <= 1:
|
|
> return n
|
|
> else:
|
|
> return fibonacci(n-1) + fibonacci(n-2
|
|
> ```
|
|
``` |