Add Qwen3 MoE (#2934)

* qwen-moe rebase

* lint

* fixed rebase error

* swapped normal MoE model with CausalMoE Model in example, and swapped the tie word embeddings if statement

* updated readme
This commit is contained in:
Kyle Birnbaum
2025-05-31 06:33:28 -07:00
committed by GitHub
parent cd7b877d6b
commit 0224a749f0
4 changed files with 393 additions and 1 deletions

View File

@ -100,6 +100,7 @@ pub mod quantized_t5;
pub mod qwen2;
pub mod qwen2_moe;
pub mod qwen3;
pub mod qwen3_moe;
pub mod recurrent_gemma;
pub mod repvgg;
pub mod resnet;