4 Commits

Author	SHA1	Message	Date
laurent	122e334d0c	Simplify the pattern matching logic in the cuda backend.	2023-06-29 09:21:11 +01:00
laurent	c44e5346f4	Add some helper functions.	2023-06-27 17:37:09 +01:00
laurent	318503cd38	Cache the causal mask in llama.	2023-06-27 12:21:08 +01:00
Nicolas Patry	d7f729fb8f	Refactor the hierarchy.	2023-06-27 11:57:27 +02:00