Commit Graph

8 Commits

Author SHA1 Message Date
3872dc4751 Merge pull request #19 from LaurentMazare/llama_safetensors
Llama safetensors
2023-06-29 12:49:26 +02:00
122e334d0c Simplify the pattern matching logic in the cuda backend. 2023-06-29 09:21:11 +01:00
ece3ec6167 Final updates -> moving to deterministic for easier comparison. 2023-06-28 14:56:39 +00:00
926fffa0b7 Ok. 2023-06-28 14:56:39 +00:00
e29dae044d Tmp. 2023-06-28 14:56:38 +00:00
c44e5346f4 Add some helper functions. 2023-06-27 17:37:09 +01:00
318503cd38 Cache the causal mask in llama. 2023-06-27 12:21:08 +01:00
d7f729fb8f Refactor the hierarchy. 2023-06-27 11:57:27 +02:00