huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-19 11:56:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add a quantized version of the t5 model. (#921)

Browse Source
This commit is contained in:
Laurent Mazare
2023-09-21 11:13:39 +01:00
committed by GitHub
parent c89b82b2d4
commit 2619c4307f
5 changed files with 873 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
candle-core/src/quantized/mod.rs
View File

@ -229,7 +229,7 @@ impl QTensor {
}
}
#[derive(Debug)]
#[derive(Clone, Debug)]
pub struct QMatMul(std::sync::Arc<QTensor>);
impl QMatMul {