huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-19 03:54:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
d0cdea95a5ec8f53b24c6de19f6029060339ed98
candle/candle-pyo3
History
Laurent Mazare 20512ba408 Return the metadata in the gguf pyo3 bindings. (#729) 
* Return the metadata in the gguf pyo3 bindings.

* Read the metadata in the quantized llama example.

* Get inference to work on gguf files.
2023-09-04 07:07:00 +01:00
..
src
Return the metadata in the gguf pyo3 bindings. (#729)
2023-09-04 07:07:00 +01:00
build.rs
Fix the pyo3 build for macos. (#324)
2023-08-05 14:53:57 +01:00
Cargo.toml
Sketch a quantized llama using the pyo3 api. (#715)
2023-09-02 11:26:05 +01:00
quant-llama.py
Return the metadata in the gguf pyo3 bindings. (#729)
2023-09-04 07:07:00 +01:00
README.md
Recommend using maturin. (#717)
2023-09-02 16:19:35 +01:00
test.py
Recommend using maturin. (#717)
2023-09-02 16:19:35 +01:00

README.md

From the candle-pyo3 directory, enable a virtual env where you will want the candle package to be installed then run.

maturin develop
python test.py