huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-19 11:56:45 +00:00
Code Issues Packages Projects Releases Wiki Activity

Llama quantization. (#625)

Browse Source
This commit is contained in:
Laurent Mazare
2023-08-27 14:08:15 +01:00
committed by GitHub
parent 7151f2cf63
commit be471d50ab
2 changed files with 79 additions and 15 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
candle-core/src/quantized/mod.rs
View File

@ -202,6 +202,10 @@ impl QTensor {
self.data.dtype()
}
pub fn rank(&self) -> usize {
self.shape.rank()
}
pub fn shape(&self) -> &Shape {
&self.shape
}