huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 04:10:46 +00:00
Code Issues Packages Projects Releases Wiki Activity

Fixing quantized llama demo on metal. (#1703)

Browse Source
This commit is contained in:
Nicolas Patry
2024-02-13 16:28:56 +01:00
committed by GitHub
parent ad73e93da2
commit c1b418586c
4 changed files with 34 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
candle-core/src/quantized/metal.rs
View File

@ -14,6 +14,10 @@ impl QMetalStorage {
self.dtype
}
pub fn device(&self) -> &MetalDevice {
&self.device
}
pub fn buffer(&self) -> &Buffer {
&self.buffer
}