Add a repeat penality to the llama2-c command line example. (#713)

* Add a repeat penality to the llama2-c command line example. * Another fix attempt.
2025-06-16 10:38:54 +00:00 · 2023-09-01 21:38:58 +02:00
parent 4d56cef583
commit 2c1df6bba1
2 changed files with 19 additions and 1 deletions
--- a/candle-wasm-examples/llama2-c/src/bin/m.rs
+++ b/candle-wasm-examples/llama2-c/src/bin/m.rs
@ -25,7 +25,7 @@ impl Model {
            candle_transformers::utils::apply_repeat_penalty(
                &logits,
                self.repeat_penalty,
-                &tokens[start_at..],
+                &self.tokens[start_at..],
            )?
        };