huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 03:28:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

Allow for lazy loading of npz files, use it in llama to reduce memory usage in the cpu version. (#141)

Browse Source
This commit is contained in:
Laurent Mazare
2023-07-11 20:22:34 +01:00
committed by GitHub
parent 37cad85869
commit fa760759e5
4 changed files with 77 additions and 9 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
candle-core/src/lib.rs
View File

@ -48,7 +48,7 @@ mod indexer;
mod layout;
#[cfg(feature = "mkl")]
mod mkl;
mod npy;
pub mod npy;
mod op;
pub mod safetensors;
mod shape;