6 Commits

Author	SHA1	Message	Date
Laurent	58c1e909d3	Handle contiguity + bugfix + use in mimi.	2024-09-22 13:43:46 +02:00
Laurent	9964c6d86c	Improve the api for the rotating cache so that the whole src tensor gets returned when it's overlarge.	2024-09-22 13:23:23 +02:00
Laurent	fc877920ce	More tests for the rotating kv-cache.	2024-09-22 12:57:46 +02:00
Laurent	6547c4bfc3	More kv-cache testing.	2024-09-22 12:51:07 +02:00
Laurent	f9579f80be	Test the reset too.	2024-09-22 12:46:18 +02:00
Laurent	1bddd44cb8	Add some KvCache tests.	2024-09-22 12:44:09 +02:00