huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-15 02:16:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
2ed78ab336c99080b1f8830f48ea40e2e1026249
candle/candle-pyo3
History
Laurent Mazare 2ed78ab336 Support for quantized tensors in the python api. (#706) 
* Add more pyo3 support.

* Add some support for quantized tensors in pyo3.

* Add an arc layer on qmatmul.

* Add the quantized matmul.

* Quantization support.

* More quantization support.

* Test the python quantization.
2023-09-01 15:53:42 +01:00
..
src
Support for quantized tensors in the python api. (#706)
2023-09-01 15:53:42 +01:00
build.rs
Fix the pyo3 build for macos. (#324)
2023-08-05 14:53:57 +01:00
Cargo.toml
Add some documentation. (#673)
2023-08-30 11:54:00 +01:00
README.md
Fix the pyo3 build for macos. (#324)
2023-08-05 14:53:57 +01:00
test.py
Support for quantized tensors in the python api. (#706)
2023-09-01 15:53:42 +01:00

README.md

From the top level directory run the following for linux.

cargo build --profile=release-with-debug --package candle-pyo3 && cp -f ./target/release-with-debug/libcandle.so candle.so
PYTHONPATH=. python3 candle-pyo3/test.py
```bash

  Or for macOS users:
```bash
cargo build --profile=release-with-debug --package candle-pyo3 && cp -f ./target/release-with-debug/libcandle.dylib candle.so
PYTHONPATH=. python3 candle-pyo3/test.py