huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 02:38:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
3071134788334c972d9e356f53887d2b2ff026b7
candle/candle-examples/examples
History
Laurent Mazare 3071134788 Get the ggml based llama to generate some text. (#464) 
* Add more stats to the ggml example.

* Build a quantized model from the file content.

* Move the tensor retrieval in the main crate.

* Start adding the forward pass.

* Add more to the forward pass of the quantized llama.

* Apply the attention layers.

* Add the sampling loop.

* Get the sampling loop to work.

* Minor tweak.

* Add a quantize/dequantize test.

* Bugfix.

* Add a comment + swap the order.

* Bugfixes.
2023-08-16 12:41:07 +01:00
..
bert
Add a cuda kernel for upsampling. (#441)
2023-08-14 13:12:17 +01:00
bigcode
Add a cuda kernel for upsampling. (#441)
2023-08-14 13:12:17 +01:00
custom-ops
Use bail rather than wrapping a string where possible. (#249)
2023-07-26 15:42:46 +01:00
falcon
Add a cuda kernel for upsampling. (#441)
2023-08-14 13:12:17 +01:00
ggml
Get the ggml based llama to generate some text. (#464)
2023-08-16 12:41:07 +01:00
llama
Get the ggml based llama to generate some text. (#464)
2023-08-16 12:41:07 +01:00
llama2-c
Support the Accelerate BLAS on macOS. (#325)
2023-08-05 17:25:24 +01:00
llama_multiprocess
Remove the checkpoint conversion script. (#405)
2023-08-11 05:59:48 +01:00
mnist-training
Add the candle-datasets crate (#322)
2023-08-05 08:56:50 +01:00
musicgen
Remove the embedding ops in favor of index-select. (#299)
2023-08-02 05:42:11 +01:00
stable-diffusion
Track the conv2d operations in stable-diffusion. (#431)
2023-08-13 15:58:26 +01:00
whisper
Add a cuda kernel for upsampling. (#441)
2023-08-14 13:12:17 +01:00