8 Commits

Author	SHA1	Message	Date
Nicolas Patry	2df044f9a1	Clippy after rebase.	2023-07-07 09:22:09 +02:00
Nicolas Patry	1ec221a749	Fixing falcon example.	2023-07-07 09:13:55 +02:00
Laurent Mazare	d38a926c14	Convert the logits to f32 before extracting them. (#102)	2023-07-07 08:07:57 +01:00
Laurent Mazare	bac4ef40f3	Add some text generation pipeline for falcon. (#98)	2023-07-07 06:34:22 +01:00
Laurent Mazare	2b8e8c9f14	Bugfixes. (#97)	2023-07-06 23:26:11 +01:00
Laurent Mazare	a3f3b93d16	Add the call to dense in the attention layer. (#96)	2023-07-06 23:22:08 +01:00
Laurent Mazare	0f679fe42e	Fix some shape issues in falcon. (#95) ... * Fix some shape issues. * Use different dtypes.	2023-07-06 19:23:54 +01:00
Laurent Mazare	4afa461b34	Sketch the Falcon model. (#93) ... * Sketch the Falcon model. * Add more substance to the falcon example. * Falcon (wip). * Falcon (wip again). * Falcon inference. * Get the weights from the api and properly generate the model. * Use the proper model. * Fix the file/revision names. * Fix bias handling. * Recompute the rot embeddings. * Fix the input shape. * Add the release-with-debug profile. * Silly bugfix. * More bugfixes. * Stricter shape checking in matmul.	2023-07-06 19:01:21 +01:00