Sketching the musicgen model. (#66)

* Skeleton files for musicgen.

* Add a musicgen model module.

* Sketch the model loading.

* Start adding the forward pass.

* More forward pass.

* Positional embeddings.

* Forward for the decoder layers.

* Add an empty function.

* Fix the musicgen weight names.

* More musicgen modeling.

* Add the T5 loading bits.

* Add the encodec config.

* Add the encodec module hierarchy.

* More Encodec modeling.

* Encodec modeling.

* Encodec modeling.

* Add more to the encodec modeling.

* Load the weights.

* Populate the resnet blocks.

* Also load the conv transpose weights.

* Split musicgen in multiple files.
This commit is contained in:
Laurent Mazare
2023-07-09 19:53:35 +01:00
committed by GitHub
parent c187f347bf
commit ea5dfa69bc
6 changed files with 1497 additions and 1 deletions

View File

@ -1,5 +1,5 @@
#![allow(dead_code)]
// TODO: KV cache.
// TODO: Add an offline mode.
#[cfg(feature = "mkl")]
extern crate intel_mkl_src;