mirror of
https://github.com/huggingface/candle.git
synced 2025-06-19 19:58:35 +00:00
Documentation Pass for Models (#2617)
* links in chinese_clip * links for clip model * add mod docs for flux and llava * module doc for MMDIT and MIMI * add docs for a few more modesl * mod docs for bert naser and beit * add module docs for convmixer colpali codegeex and chatglm * add another series of moddocs * add fastvit-llama2_c * module docs mamba -> mobileone * module docs from moondream-phi3 * mod docs for quantized and qwen * update to yi * fix long names * Update llama2_c.rs * Update llama2_c_weights.rs * Fix the link for mimi + tweaks --------- Co-authored-by: Laurent Mazare <laurent.mazare@gmail.com>
This commit is contained in:
@ -1,3 +1,20 @@
|
||||
//! Qwen2 model implementation with quantization support.
|
||||
//!
|
||||
//! Qwen2 is a large language model from Alibaba optimized for efficiency.
|
||||
//! This implementation provides quantization for reduced memory and compute.
|
||||
//!
|
||||
//! Key characteristics:
|
||||
//! - Streaming decode support
|
||||
//! - Grouped query attention (GQA)
|
||||
//! - RMSNorm for layer normalization
|
||||
//! - Rotary positional embeddings (RoPE)
|
||||
//! - Support for 8-bit quantization
|
||||
//!
|
||||
//! References:
|
||||
//! - [Qwen2 Model](https://huggingface.co/Qwen/Qwen2-7B)
|
||||
//! - [Model Card](https://huggingface.co/Qwen/Qwen2-7B)
|
||||
//!
|
||||
|
||||
use crate::models::with_tracing::{linear, linear_no_bias, Linear, RmsNorm};
|
||||
use candle::{DType, Device, IndexOp, Module, Result, Tensor, D};
|
||||
use candle_nn::{Activation, VarBuilder};
|
||||
|
Reference in New Issue
Block a user