mirror of
https://github.com/huggingface/candle.git
synced 2025-06-15 10:26:33 +00:00
6ff0a6999c
* gemma3: changed RotaryEmbedding base freq based on layer and sliding window * Changed attention mask per layer, either normal or sliding * made attention mask creation slightly more efficient by only creating them once per model iteration * changed is_sliding to an Option * clippy * changed to stop on both <eos> and <end_of_turn> instead of either or