mirror of
https://github.com/huggingface/candle.git
synced 2025-06-19 03:54:56 +00:00

* Retrieve the current positions for rotating KV caches. * Add the function to the kv cache too. * More testing.
* Retrieve the current positions for rotating KV caches. * Add the function to the kv cache too. * More testing.