huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-14 09:57:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,385 Commits 74 Branches 16 Tags
main
Commit Graph

4 Commits

Author SHA1 Message Date
Laurent Mazare
1ba87a9450 Use BF16 on metal when possible. (#2378) 2024-08-01 10:48:58 +02:00
Laurent Mazare
7c7400fb63 Use the tokenizer-output-stream in the llama example. (#1715) 
* Use the tokenizer-output-stream in the llama example.

* Also use tokenizer-output-stream for llama2-c.
 2024-02-15 16:47:33 +01:00
Laurent Mazare
37c539f2b7 Helper function to load sharded safetensors files (#1481) 
* Fix the quantized mistral example.

* Add a helper function to load sharded safetensors weights.

* Use the sharded loader.
 2023-12-25 21:49:21 +01:00
Laurent Mazare
614842b311 Add the Mixtral model. (#1437) 
* Add the Mixtral model.

* Add more of the mixtral layers.

* Add the final layers for mixtral.

* Sketch the expert selection.

* Add some expert routing logic.

* Hopefully finish the routing logic for mixtral.

* Add the mixtral example.

* Fix the weight filenames.

* Bugfix.

* Another fix.

* Yet another fix + remove the unused pragma.

* Shape fix.

* Add a readme.
 2023-12-15 14:19:56 -06:00