mirror of
https://github.com/huggingface/candle.git
synced 2025-06-17 11:08:52 +00:00
f48c07e242
* Include topk sampling in the quantized example. * Also sample with top-k on the mistral side.