Gemma 3 initial setup (text only). (#2802)

* Gemma 3 initial setup (text only).

* Use the rotating kv cache for the sliding window.
This commit is contained in:
Laurent Mazare
2025-03-14 07:56:02 +01:00
committed by GitHub
parent e286cf7cc9
commit 111edbc4ea
3 changed files with 522 additions and 27 deletions

View File

@ -43,6 +43,7 @@ pub mod fastvit;
pub mod flux;
pub mod gemma;
pub mod gemma2;
pub mod gemma3;
pub mod glm4;
pub mod granite;
pub mod helium;