Laurent Mazare c1b9e07e35 Add support for gemma-2. (#2425) ...

* Add gemma-2.

* Support a couple more models.

* Sliding window support.

* Example + readme updates.

* Update the main readme.

2024-08-17 20:31:23 +02:00

..

clip

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

flux

Simplify handling of flux modulations. (#2394)

2024-08-04 11:09:54 +02:00

llava

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

mmdit

Add the MMDiT model of Stable Diffusion 3 (#2397)

2024-08-05 19:26:15 +02:00

segment_anything

Relax the contiguous check for cuda kernels. (#2000)

2024-04-03 09:02:38 +02:00

stable_diffusion

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

whisper

Speaker embeddings computation for metavoice. (#1800)

2024-03-04 14:13:01 +01:00

wuerstchen

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

based.rs

Add Based LLM from Hazy Research. (#2411)

2024-08-12 21:21:19 +02:00

beit.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

bert.rs

Fix the device for the bert attention mask. (#2414)

2024-08-14 10:01:12 +02:00

bigcode.rs

Support for attention bias in gemma + refactor things a bit. (#1744)

2024-02-22 09:35:28 +01:00

blip_text.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

blip.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

chatglm.rs

Support for attention bias in gemma + refactor things a bit. (#1744)

2024-02-22 09:35:28 +01:00

codegeex4_9b.rs

feat(candle-transformers/models/codegeex4-9b): add codegeex4-9 (#2334)

2024-07-21 13:00:41 +02:00

convmixer.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

convnext.rs

Add ConvNeXt-V2 and smaller model variants. (#1709)

2024-02-14 10:53:07 +01:00

depth_anything_v2.rs

Depth Anything v2 (#2279)

2024-06-24 19:12:52 +02:00

dinov2.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

dinov2reg4.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

distilbert.rs

Distibert (#1366)

2023-11-24 15:09:14 +00:00

efficientnet.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

efficientvit.rs

EfficientVit (MSRA) model (#1783)

2024-03-01 08:53:52 +01:00

encodec.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

eva2.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

falcon.rs

Make the falcon model cloneable. (#2067)

2024-04-15 09:39:03 +02:00

gemma2.rs

Add support for gemma-2. (#2425)

2024-08-17 20:31:23 +02:00

gemma.rs

Use flash-attn in gemma. (#2195)

2024-05-18 19:18:59 +02:00

glm4.rs

add models support and example for THUDM/glm-4 (#2362)

2024-08-05 17:48:09 +02:00

hiera.rs

Add Hiera vision model. (#2382)

2024-08-01 11:59:22 +02:00

jina_bert.rs

Fix cargo fmt. (#2383)

2024-08-01 14:19:41 +02:00

llama2_c_weights.rs

Move the llama2-c model in transformers. (#1205)

2023-10-28 16:51:19 +01:00

llama2_c.rs

Avoid the attention mask where possible. (#1933)

2024-03-25 15:31:04 +01:00

llama.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

mamba.rs

Support alternative dtypes for mamba (#2036)

2024-04-10 18:10:01 +02:00

marian.rs

Remove the unused pragma for marian. (#1236)

2023-11-01 20:04:52 +00:00

metavoice.rs

Add some tracing to metavoice. (#1826)

2024-03-09 12:24:11 +01:00

mistral.rs

Support for mistral-nemo. (#2396)

2024-08-04 19:52:40 +02:00

mixformer.rs

Faster mask implementation for mixformers. (#2017)

2024-04-05 09:38:26 +02:00

mixtral.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

mobilenetv4.rs

Add Mobilenet v4 (#2325)

2024-07-09 13:52:20 +02:00

mobileone.rs

Add MobileOne model. (#1595)

2024-01-16 06:34:16 +01:00

mod.rs

Add support for gemma-2. (#2425)

2024-08-17 20:31:23 +02:00

moondream.rs

Add Debug, Clone, Deserialize to moondream config (#2222)

2024-05-28 06:08:00 +02:00

mpt.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

olmo.rs

Add Olmo models (#2127)

2024-04-26 11:02:51 +02:00

persimmon.rs

Add the relu2 and relu6 activations. (#1201)

2023-10-27 20:51:16 +01:00

phi3.rs

Separate quantized phi-3 implementation. (#2157)

2024-05-04 10:14:57 +02:00

phi.rs

Enable the new layer-norm. (#2213)

2024-05-24 16:48:21 +02:00

quantized_blip_text.rs

Add a quantized blip model. (#1155)

2023-10-22 20:33:25 +01:00

quantized_blip.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

quantized_llama2_c.rs

Avoid the attention mask where possible. (#1933)

2024-03-25 15:31:04 +01:00

quantized_llama.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_metavoice.rs

Fix the final rmsnorm for quantized-metavoice. (#2021)

2024-04-06 19:35:01 +02:00

quantized_mistral.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_mixformer.rs

Quantized moondream implementation and BOS token (#1980)

2024-04-01 19:37:54 +02:00

quantized_moondream.rs

Quantized moondream implementation and BOS token (#1980)

2024-04-01 19:37:54 +02:00

quantized_mpt.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_phi3.rs

Avoid a contiguous call in the quantized phi 3 model. (#2209)

2024-05-23 21:24:55 +02:00

quantized_phi.rs

Updated quantized phi model (#2099)

2024-04-21 07:37:07 +02:00

quantized_qwen2.rs

add quantized qwen2 (#2329)

2024-07-12 10:00:03 +02:00

quantized_recurrent_gemma.rs

Add a quantized version of recurrent-gemma. (#2054)

2024-04-13 20:07:01 +02:00

quantized_rwkv_v5.rs

add quantized rwkv v5 model (#1743)

2024-02-25 21:43:40 +01:00

quantized_rwkv_v6.rs

add models of rwkv v6 and quantized rwkv v6 (#1781)

2024-03-01 08:37:56 +01:00

quantized_stable_lm.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_t5.rs

Add support to UL2 model family (#1300)

2023-11-09 18:55:09 +01:00

qwen2_moe.rs

Add argsort. (#2132)

2024-04-27 20:17:35 +02:00

qwen2.rs

Support for the new Qwen2 models. (#2257)

2024-06-07 10:51:50 +01:00

recurrent_gemma.rs

Add a quantized version of recurrent-gemma. (#2054)

2024-04-13 20:07:01 +02:00

repvgg.rs

Add RepVGG model. (#1561)

2024-01-11 07:07:40 +01:00

resnet.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

rwkv_v5.rs

add quantized rwkv v5 model (#1743)

2024-02-25 21:43:40 +01:00

rwkv_v6.rs

add models of rwkv v6 and quantized rwkv v6 (#1781)

2024-03-01 08:37:56 +01:00

segformer.rs

Add an initial Segformer implementation (#1617)

2024-03-03 16:01:46 +01:00

stable_lm.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

starcoder2.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

t5.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

trocr.rs

Support sinusoidal embeddings in trocr. (#1690)

2024-02-10 15:17:51 +01:00

vgg.rs

Fix the fast bf16 gemm cublas kernels. (#2274)

2024-06-18 23:46:58 +02:00

vit.rs

Use the repo config for trocr rather than hardcoding it + small tweaks. (#1689)

2024-02-10 13:15:03 +01:00

with_tracing.rs

Use the faster rms-norm kernel for llama. (#2107)

2024-04-22 18:52:00 +02:00

yi.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00