huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-20 04:00:28 +00:00
Code Issues Packages Projects Releases Wiki Activity
1,088 Commits 74 Branches 16 Tags
26cd266e6569b0640947d4cacb4d6b9c27c01623
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
21109e1983 Recommend using maturin. (#717) 2023-09-02 16:19:35 +01:00
Laurent Mazare
ad796eb4be More quantized llama in python. (#716) 
* More quantized llama in python.

* Expose a couple more functions.

* Apply the last layer.

* Use the vocab from the ggml files.
 2023-09-02 13:41:48 +01:00
Laurent Mazare
e8e33752f4 Sketch a quantized llama using the pyo3 api. (#715) 
* Sketch a quantized llama using the pyo3 api.

* Add more ops.

* Expose a few more functions to use in the quantized model.

* Rope embeddings.

* Get the forward pass to work.
 2023-09-02 11:26:05 +01:00