6 Commits

Author	SHA1	Message	Date
Laurent Mazare	06e46d7c3b	Only use classifier free guidance for the prior. (#896) ... * Only use classifier free guidance for the prior. * Add another specific layer-norm structure. * Tweaks. * Fix the latent shape. * Print the prior shape. * More shape fixes. * Remove some debugging continue.	2023-09-19 14:13:05 +01:00
Laurent Mazare	92db8cecd3	Specialized attention module for Wuerstchen. (#890) ... * Specialized attention module for Wuerstchen. * Reshaping ops. * Attention processor. * Finish the forward pass. * Hook the new attention processor. * Get the prior forward pass to work. * Make it contiguous.	2023-09-18 21:16:09 +01:00
Laurent Mazare	c2b866172a	More Wuerstchen fixes. (#882) ... * More Weurstchen fixes. * More shape fixes. * Add more of the prior specific bits. * Broadcast add. * Fix the clip config. * Add some masking options to the clip model.	2023-09-17 22:08:11 +01:00
Laurent Mazare	06cc329e71	Remove the parameters for the Wuerstchen layer-norm. (#879) ... * Remove the parameters for the Wuerstchen layer-norm. * Fixes. * More fixes (including conv-transpose2d. * More fixes. * Again more fixes.	2023-09-17 15:59:27 +01:00
Laurent Mazare	a0c6d5548c	Add the attention block. (#846) ... * Add the attention block. * Add more to clipnext.	2023-09-14 15:40:09 +01:00
Laurent Mazare	286f01db14	Start adding the Wuerstchen diffusion pipeline (#843) ... * Wuerstchen common bits. * Add the prior layer. * Start adding diffnext.	2023-09-14 10:56:07 +01:00