mirror of
https://github.com/huggingface/candle.git
synced 2025-06-15 18:28:24 +00:00

* Retrieve the current positions for rotating KV caches. * Add the function to the kv cache too. * More testing.
* Retrieve the current positions for rotating KV caches. * Add the function to the kv cache too. * More testing.