13 Commits

Author	SHA1	Message	Date
Laurent Mazare	eae646d322	Use arange in the examples. (#146)	2023-07-12 12:12:34 +01:00
Laurent Mazare	20599172ac	Add from_iter and arange, use it in the doctests. (#145)	2023-07-12 12:03:01 +01:00
Laurent Mazare	b3b39cca92	Llama batch (#144) ... * Add a batch dimension to llama. * Bugfixes.	2023-07-12 11:38:19 +01:00
Laurent Mazare	fa760759e5	Allow for lazy loading of npz files, use it in llama to reduce memory usage in the cpu version. (#141)	2023-07-11 20:22:34 +01:00
Laurent Mazare	37cad85869	Resurrect the llama npy support. (#140)	2023-07-11 19:32:10 +01:00
Laurent Mazare	760f1d7055	Refactor the llama example to make it more in sync with the other ones. (#139) ... * Refactor the llama example to make it more in sync with the other ones. * Make clippy happy. * Properly load the safetensor weights. * Get llama back to a working state for the safetensors case.	2023-07-11 17:20:55 +01:00
Laurent Mazare	e923b3adc2	Add a KV cache to falcon. (#104)	2023-07-07 17:24:38 +01:00
Nicolas Patry	115629fe08	Creating new sync Api for candle-hub. ... - `api::Api` -> `api::tokio::api` (And created new `api::sync::Api`). - Remove `tokio` from all our examples. - Using similar codebase for now instead of ureq (for simplicity).	2023-07-06 15:15:25 +02:00
Laurent Mazare	dd60bd84bb	MKL adjustments. (#87)	2023-07-06 11:37:27 +01:00
Laurent Mazare	c297a50960	Add mkl support for matrix multiply. (#86) ... * Fix some rebase issues. * Use mkl instead. * Use mkl in bert. * Add the optional mkl feature. * Conditional compilation based on the mkl feature. * Add more mkl support.	2023-07-06 11:05:05 +01:00
laurent	e2bfbcb79c	Support dim indexes in cat.	2023-07-05 20:39:08 +01:00
laurent	2c3d871b2e	Add a simpler way to specify the dim index for some ops.	2023-07-05 20:22:43 +01:00
laurent	fdb1acd2ff	Move llama in a cargo-examples directory.	2023-07-03 11:30:58 +01:00