huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 03:28:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

Preliminary GGUF support. (#557)

Browse Source 
* Preliminary GGUF support.

* Tensor reading.
This commit is contained in:
Laurent Mazare
2023-08-23 00:14:10 +01:00
committed by GitHub
parent 7687a0f453
commit 6a30ecefad
2 changed files with 221 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
candle-core/src/quantized/mod.rs
View File

@ -3,6 +3,7 @@ use crate::{Device, Result, Shape, Tensor};
#[cfg(target_feature = "avx")]
pub mod avx;
pub mod ggml_file;
pub mod gguf_file;
pub mod k_quants;
#[cfg(target_feature = "neon")]
pub mod neon;