8 Commits

Author	SHA1	Message	Date
Kyle Birnbaum	d6db305829	Added new language pairs to marian-mt example. (#2860) ... * added new language pairs to marian-mt * lint * seperated python code for converting tokenizers into its own file and and added a reqirements.txt for dependencies, updated instructions in readme and included python version * Cleanup. --------- Co-authored-by: Laurent <laurent.mazare@gmail.com>	2025-04-02 23:50:14 +02:00
Laurent Mazare	b75ef051cf	Fix the marian tokenizer importer. (#2426) ... * Fix the marian tokenizer importer. * Ignore the python caches.	2024-08-17 20:58:40 +02:00
Laurent Mazare	c12ad45562	Add a KV cache to marian decoding. (#1226)	2023-10-31 08:47:44 +00:00
Laurent Mazare	7d0202710b	Instructions for generating the tokenizer configs for marian-mt. (#1225)	2023-10-31 07:56:26 +01:00
Laurent Mazare	392a00a147	Add support for the marian base model. (#1221)	2023-10-30 19:20:36 +00:00
Laurent Mazare	4c967b9184	Use the hub files for the marian example. (#1220) ... * Use the hub files for the marian example. * Use the secondary decoder. * Add a readme. * More readme.	2023-10-30 17:29:36 +00:00
Laurent Mazare	969960847a	Bugfixes for marian-mt. (#1219) ... * Bugfixes for marian-mt. * Apply the final decoding head. * More fixes.	2023-10-30 11:44:19 +00:00
Laurent Mazare	7bbde55c61	Marian MT model (#1210) ... * Skeleton files for the marian MT model. * Marian initialization. * Implement the attention forward method. * Forward pass for the encoder side. * Expose the encoder and decoder. * Start plugging the decoder. * Forward pass for the decoder layer. * Set up the marian example. * Add some missing backtraces. * Bugfix.	2023-10-29 15:12:22 +00:00