5 Commits

Author	SHA1	Message	Date
Laurent Mazare	ce0a4e3a85	Use the gelu-erf activation. (#969)	2023-09-26 22:30:21 +01:00
Laurent Mazare	07067b01dc	Avoid some mutable variables (take 2). (#554) ... * Avoid some mutable variables (take 2). * Fix.	2023-08-22 18:51:20 +01:00
Laurent Mazare	ec665acad7	Revert "Avoid some mut in quantized functions. (#550)" (#552) ... This reverts commit cf27b9b636.	2023-08-22 15:57:46 +01:00
Laurent Mazare	cf27b9b636	Avoid some mut in quantized functions. (#550) ... * Avoid a couple more 'let mut'. * Tweaks.	2023-08-22 15:44:26 +01:00
Lukas Kreussel	352383cbc3	Add quantization support for q2k, q3k, q4k and q5k (#524) ... * first q2 implementation * First Q4K and Q5K implementations * fix `q2k` and `q5k` * Some first cleanups * run `clippy` on tests * finally implement `q3k` * deactivate `q3k` test on macos * also disable the test on linux * Fix floating bits in `q3k` dequantization * Refactoring pass + reorder quants in file * `fmt` * Re-add `src` asserts and redefine `dst`	2023-08-22 15:04:55 +01:00