2 Commits

Author	SHA1	Message	Date
Laurent Mazare	b13a82a438	Separate quantized phi-3 implementation. (#2157) ... * Separate quantized phi-3 implementation. * Integrate the quantized phi3 model.= * Small fixes, get the generation to work properly. * Keep the old llama implementation around. * Change the default.	2024-05-04 10:14:57 +02:00
Laurent Mazare	11d4a3c588	Add the phi-3 model. (#2120) ... * Add the phi-3 model. * Faster rope. * Bugfix. * Fix the detokenization.	2024-04-24 09:48:13 +02:00