59 Commits

Author	SHA1	Message	Date
Laurent Mazare	760f1d7055	Refactor the llama example to make it more in sync with the other ones. (#139) ... * Refactor the llama example to make it more in sync with the other ones. * Make clippy happy. * Properly load the safetensor weights. * Get llama back to a working state for the safetensors case.	2023-07-11 17:20:55 +01:00
Laurent Mazare	674eb35e10	Remove some dead-code pragmas. (#137)	2023-07-11 09:33:59 +01:00
Laurent Mazare	e923b3adc2	Add a KV cache to falcon. (#104)	2023-07-07 17:24:38 +01:00
Nicolas Patry	115629fe08	Creating new sync Api for candle-hub. ... - `api::Api` -> `api::tokio::api` (And created new `api::sync::Api`). - Remove `tokio` from all our examples. - Using similar codebase for now instead of ureq (for simplicity).	2023-07-06 15:15:25 +02:00
Laurent Mazare	dd60bd84bb	MKL adjustments. (#87)	2023-07-06 11:37:27 +01:00
Laurent Mazare	c297a50960	Add mkl support for matrix multiply. (#86) ... * Fix some rebase issues. * Use mkl instead. * Use mkl in bert. * Add the optional mkl feature. * Conditional compilation based on the mkl feature. * Add more mkl support.	2023-07-06 11:05:05 +01:00
laurent	e2bfbcb79c	Support dim indexes in cat.	2023-07-05 20:39:08 +01:00
laurent	2c3d871b2e	Add a simpler way to specify the dim index for some ops.	2023-07-05 20:22:43 +01:00
laurent	fdb1acd2ff	Move llama in a cargo-examples directory.	2023-07-03 11:30:58 +01:00