10 Commits

Author	SHA1	Message	Date
Laurent Mazare	be471d50ab	Llama quantization. (#625)	2023-08-27 14:08:15 +01:00
Laurent Mazare	7151f2cf63	Add the quantize command. (#624) ... * Add the quantize command. * Bugfix for writing gguf files. * And add a comment.	2023-08-27 11:35:19 +01:00
Laurent Mazare	2cde0cb74b	More pickle support. (#588) ... * More pickle support. * Be more verbose.	2023-08-24 18:45:10 +01:00
Laurent Mazare	0764741cc4	Handle GGUF files in tensor-tools. (#558)	2023-08-23 06:32:07 +01:00
Laurent Mazare	551409092e	Small tweaks to tensor-tools. (#517)	2023-08-19 16:50:26 +01:00
Laurent Mazare	6431140250	Retrieve tensor data from PyTorch files. (#516)	2023-08-19 15:57:18 +01:00
Laurent Mazare	607ffb9f1e	Retrieve more information from PyTorch checkpoints. (#515) ... * Retrieve more information from PyTorch checkpoints. * Add enough support to load dino-v2 backbone weights.	2023-08-19 15:05:34 +01:00
Laurent Mazare	f861a9df6e	Add ggml support to tensor-tools (#512) ... * Pickle work-in-progress. * More unpickling. * More pickling. * Proper handling of setitems. * Clippy. * Again more pickling. * Restore the example. * Add enough pickle support to get the list of tensors. * Read the data from zip files. * Retrieve the tensor shape. * Extract the size and dtype. * More storage types. * Improve the destructuring. * Also support ggml files.	2023-08-19 11:45:22 +01:00
Laurent Mazare	ad33715c61	Preliminary support for importing PyTorch weights. (#511) ... * Pickle work-in-progress. * More unpickling. * More pickling. * Proper handling of setitems. * Clippy. * Again more pickling. * Restore the example. * Add enough pickle support to get the list of tensors. * Read the data from zip files. * Retrieve the tensor shape. * Extract the size and dtype. * More storage types. * Improve the destructuring.	2023-08-19 11:26:32 +01:00
Laurent Mazare	90ff04e77e	Add the tensor-tools binary. (#510)	2023-08-19 09:06:44 +01:00