huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 20:22:49 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,085 Commits 74 Branches 16 Tags
74a82c358a9fd160b52230a28d9929c32e95ecba
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
21109e1983 Recommend using maturin. (#717) 2023-09-02 16:19:35 +01:00
Laurent Mazare
ad796eb4be More quantized llama in python. (#716) 
* More quantized llama in python.

* Expose a couple more functions.

* Apply the last layer.

* Use the vocab from the ggml files.
 2023-09-02 13:41:48 +01:00
Laurent Mazare
e8e33752f4 Sketch a quantized llama using the pyo3 api. (#715) 
* Sketch a quantized llama using the pyo3 api.

* Add more ops.

* Expose a few more functions to use in the quantized model.

* Rope embeddings.

* Get the forward pass to work.
 2023-09-02 11:26:05 +01:00