Add the ChatGLM model. (#1237)

* Add the ChatGLM model. * Rotary embeddings. * Add to the forward pass. * Add to the forward pass. * Add the rotary embeddings. * Add the KV cache. * Add the chatglm example. * Bugfix. * More glm fixes. * Fix some shape issues. * Get the inference to work.
2025-06-18 19:47:12 +00:00 · 2024-02-09 11:51:38 +01:00
parent 9cadd4e644
commit 0dee8ea19b
3 changed files with 829 additions and 0 deletions
--- a/candle-transformers/src/models/mod.rs
+++ b/candle-transformers/src/models/mod.rs
@ -2,6 +2,7 @@ pub mod bert;
 pub mod bigcode;
 pub mod blip;
 pub mod blip_text;
+pub mod chatglm;
 pub mod convmixer;
 pub mod convnext;
 pub mod dinov2;