Add the jina-bert embeddings model. (#1187)

* Add the jina-bert model.

* Use alibi.

* Remove the unused pragma.

* Recompute the alibi embeddings.

* Generate the token type ids.

* Use the module trait.

* Add the jina-bert example.

* DType fix.

* Get the inference to work.
This commit is contained in:
Laurent Mazare
2023-10-26 16:54:36 +01:00
committed by GitHub
parent e37b487767
commit 5f20697918
4 changed files with 550 additions and 2 deletions

View File

@ -6,6 +6,7 @@ pub mod convmixer;
pub mod dinov2;
pub mod efficientnet;
pub mod falcon;
pub mod jina_bert;
pub mod llama;
pub mod mistral;
pub mod mixformer;