56 Commits

Author	SHA1	Message	Date
laurent	e221d38819	Factor the slicing code in cuda.	2023-06-27 15:45:59 +01:00
laurent	07a682c2ff	Run the tensor tests for the cuda backend too.	2023-06-27 15:37:01 +01:00
laurent	ca6aa8ff12	Use num-cpus to enable parallelism.	2023-06-27 14:42:26 +01:00
laurent	318503cd38	Cache the causal mask in llama.	2023-06-27 12:21:08 +01:00
laurent	380d61e990	Fix two cuda bugs (matmul and where_cond).	2023-06-27 11:31:04 +01:00
Nicolas Patry	d7f729fb8f	Refactor the hierarchy.	2023-06-27 11:57:27 +02:00