huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-20 12:06:35 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,013 Commits 74 Branches 16 Tags
805f3be8e1f28135b015ddebbe6c8ef3a8c53d13
Commit Graph

4 Commits

Author SHA1 Message Date
Laurent Mazare
4fd00b8900 Add the StarCoder2 model. (#1779) 
* Add the StarCoder2 model.

* Add the example code and get things to work.

* And also tweak the readme.
 2024-02-28 21:02:41 +01:00
Guoqing Bao
678f64dd27 Fix token generation in bilingual models (non-English outputs) (#1668) 
Co-authored-by: Guoqing Bao <guoqing.bao@enflame-tech.com>
 2024-02-06 12:03:53 +01:00
Laurent Mazare
deee7612da Quantized version of mistral. (#1009) 
* Quantized version of mistral.

* Integrate the quantized mistral variant.

* Use the quantized weight files.

* Tweak the quantization command.

* Fix the dtype when computing the rotary embeddings.

* Update the readme with the quantized version.

* Fix the decoding of the remaining tokens.
 2023-09-30 18:25:47 +01:00
Laurent Mazare
06207332bc Streaming mode for reporting the generated tokens (#1007) 
* Token streaming.

* Use the token output stream.

* Flush the output.

* Ensure that the last characters get reported.
 2023-09-30 15:04:11 +01:00