5 Commits

Author	SHA1	Message	Date
Laurent Mazare	ff876c2103	Llama more training (#297) ... * Rework the var-builder to handle initializations. * Add some helper functions for layer creation. * Improve the layer initializations. * Get initialized variables. * Precompute the rot embeddings when training lamas.	2023-08-01 19:53:41 +01:00
Laurent Mazare	ffeafbfc43	Make the nll op closer to the pytorch version + add a test. (#286)	2023-07-31 14:14:01 +01:00
Laurent Mazare	62a9b03715	Add a flag to set the number of epochs in the mnist training (#283) ... * Add a flag to change the number of epochs for the mnist training. * Increase the learning rate for the MLP.	2023-07-31 10:32:14 +01:00
Laurent Mazare	a8d8f9f206	Load a trained checkpoint in the mnist example. (#280)	2023-07-30 17:01:45 +01:00
Laurent Mazare	38ff693af0	Add a flag to save the trained weights. (#279)	2023-07-30 15:41:42 +01:00