mirror of
https://github.com/huggingface/candle.git
synced 2025-06-22 12:28:06 +00:00

* add support for l3b, new tokenizer * add todo * Add todo and use k_s model * Use the official tokenizers. --------- Co-authored-by: laurent <laurent.mazare@gmail.com>