6 Commits

Author	SHA1	Message	Date
Laurent Mazare	557b2c28dd	Q6K quantization (#495) ... * Print the detected arch options. * Add the q6k quantization. * Add a currently broken test. * Bugfix. * Bugfix. * Another bugfix. * Another bugfix + get the test to work.	2023-08-17 22:22:57 +01:00
Laurent Mazare	b278834267	Support the Accelerate BLAS on macOS. (#325) ... * Add the accelerate feature. * Ffi tweaks.	2023-08-05 17:25:24 +01:00
Laurent Mazare	66750f9827	Add some 'cuda-if-available' helper function. (#172)	2023-07-15 08:25:15 +01:00
Laurent Mazare	37cad85869	Resurrect the llama npy support. (#140)	2023-07-11 19:32:10 +01:00
laurent	8c81a70170	PyTorch like display implementation.	2023-06-27 21:16:35 +01:00
laurent	ca6aa8ff12	Use num-cpus to enable parallelism.	2023-06-27 14:42:26 +01:00