huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 10:38:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,325 Commits 74 Branches 16 Tags
metal-fp8-fun
Commit Graph

3 Commits

Author SHA1 Message Date
Laurent Mazare
deee7612da Quantized version of mistral. (#1009) 
* Quantized version of mistral.

* Integrate the quantized mistral variant.

* Use the quantized weight files.

* Tweak the quantization command.

* Fix the dtype when computing the rotary embeddings.

* Update the readme with the quantized version.

* Fix the decoding of the remaining tokens.
 2023-09-30 18:25:47 +01:00
Laurent Mazare
03348e2e6f Update mistral README.md (#995) 2023-09-29 12:24:32 +01:00
Laurent Mazare
49fa184a35 Mistral readme (#994) 
* Mistral: print the generated text.

* Add mistral to the readmes.
 2023-09-29 11:50:50 +01:00