Juan Gomez 5fc4f17727 Adding Granite 7b Instruct model example (#2487) ...

* Adding Granite 7b Instruct model example

* Minor refactoring to make it a little more idiomatic

* Clippy fixes.

* * Adding a README with some information about supported Granite models
* Changing the default prompt to accomodate better the Language
  modality of the Granite 7b Instruct model

---------

Co-authored-by: Laurent <laurent.mazare@gmail.com>

2024-09-21 11:52:01 +02:00

..

clip

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

flux

Simplify handling of flux modulations. (#2394)

2024-08-04 11:09:54 +02:00

llava

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

mimi

Add the mimi audio-tokenizer. (#2488)

2024-09-20 14:31:20 -06:00

mmdit

Add the MMDiT model of Stable Diffusion 3 (#2397)

2024-08-05 19:26:15 +02:00

openclip

MobileCLIP models S1 and S2 (#2454)

2024-08-29 15:38:58 +02:00

segment_anything

Relax the contiguous check for cuda kernels. (#2000)

2024-04-03 09:02:38 +02:00

stable_diffusion

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

whisper

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

wuerstchen

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

based.rs

Add Based LLM from Hazy Research. (#2411)

2024-08-12 21:21:19 +02:00

beit.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

bert.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

bigcode.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

blip_text.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

blip.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

chatglm.rs

Support for attention bias in gemma + refactor things a bit. (#1744)

2024-02-22 09:35:28 +01:00

codegeex4_9b.rs

feat(candle-transformers/models/codegeex4-9b): add codegeex4-9 (#2334)

2024-07-21 13:00:41 +02:00

convmixer.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

convnext.rs

Add ConvNeXt-V2 and smaller model variants. (#1709)

2024-02-14 10:53:07 +01:00

dac.rs

Add the DAC model. (#2433)

2024-08-19 08:59:51 +02:00

depth_anything_v2.rs

Depth Anything v2 (#2279)

2024-06-24 19:12:52 +02:00

dinov2.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

dinov2reg4.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

distilbert.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

efficientnet.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

efficientvit.rs

EfficientVit (MSRA) model (#1783)

2024-03-01 08:53:52 +01:00

encodec.rs

Add the DAC model. (#2433)

2024-08-19 08:59:51 +02:00

eva2.rs

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

falcon.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

fastvit.rs

FastViT fixes. (#2452)

2024-08-28 11:20:09 +02:00

gemma2.rs

Add support for gemma-2. (#2425)

2024-08-17 20:31:23 +02:00

gemma.rs

Use flash-attn in gemma. (#2195)

2024-05-18 19:18:59 +02:00

glm4.rs

add models support and example for THUDM/glm-4 (#2362)

2024-08-05 17:48:09 +02:00

granite.rs

Adding Granite 7b Instruct model example (#2487)

2024-09-21 11:52:01 +02:00

hiera.rs

Add Hiera vision model. (#2382)

2024-08-01 11:59:22 +02:00

jina_bert.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

llama2_c_weights.rs

Move the llama2-c model in transformers. (#1205)

2023-10-28 16:51:19 +01:00

llama2_c.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

llama.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

mamba.rs

Support alternative dtypes for mamba (#2036)

2024-04-10 18:10:01 +02:00

marian.rs

Remove the unused pragma for marian. (#1236)

2023-11-01 20:04:52 +00:00

metavoice.rs

Add some tracing to metavoice. (#1826)

2024-03-09 12:24:11 +01:00

mistral.rs

Support for mistral-nemo. (#2396)

2024-08-04 19:52:40 +02:00

mixformer.rs

Faster mask implementation for mixformers. (#2017)

2024-04-05 09:38:26 +02:00

mixtral.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

mobileclip.rs

MobileCLIP models S1 and S2 (#2454)

2024-08-29 15:38:58 +02:00

mobilenetv4.rs

Add Mobilenet v4 (#2325)

2024-07-09 13:52:20 +02:00

mobileone.rs

Add MobileOne model. (#1595)

2024-01-16 06:34:16 +01:00

mod.rs

Adding Granite 7b Instruct model example (#2487)

2024-09-21 11:52:01 +02:00

moondream.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

mpt.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

olmo.rs

Add Olmo models (#2127)

2024-04-26 11:02:51 +02:00

parler_tts.rs

Fix for parler-tts, do not add the last slice of padding tokens. (#2442)

2024-08-22 23:22:03 +02:00

persimmon.rs

Add the relu2 and relu6 activations. (#1201)

2023-10-27 20:51:16 +01:00

phi3.rs

Separate quantized phi-3 implementation. (#2157)

2024-05-04 10:14:57 +02:00

phi.rs

Enable the new layer-norm. (#2213)

2024-05-24 16:48:21 +02:00

quantized_blip_text.rs

Add a quantized blip model. (#1155)

2023-10-22 20:33:25 +01:00

quantized_blip.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

quantized_llama2_c.rs

Avoid the attention mask where possible. (#1933)

2024-03-25 15:31:04 +01:00

quantized_llama.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_metavoice.rs

Fix the final rmsnorm for quantized-metavoice. (#2021)

2024-04-06 19:35:01 +02:00

quantized_mistral.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_mixformer.rs

Quantized moondream implementation and BOS token (#1980)

2024-04-01 19:37:54 +02:00

quantized_moondream.rs

Quantized moondream implementation and BOS token (#1980)

2024-04-01 19:37:54 +02:00

quantized_mpt.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_phi3.rs

Avoid a contiguous call in the quantized phi 3 model. (#2209)

2024-05-23 21:24:55 +02:00

quantized_phi.rs

Updated quantized phi model (#2099)

2024-04-21 07:37:07 +02:00

quantized_qwen2.rs

add quantized qwen2 (#2329)

2024-07-12 10:00:03 +02:00

quantized_recurrent_gemma.rs

Add a quantized version of recurrent-gemma. (#2054)

2024-04-13 20:07:01 +02:00

quantized_rwkv_v5.rs

add quantized rwkv v5 model (#1743)

2024-02-25 21:43:40 +01:00

quantized_rwkv_v6.rs

add models of rwkv v6 and quantized rwkv v6 (#1781)

2024-03-01 08:37:56 +01:00

quantized_stable_lm.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

quantized_t5.rs

Add support to UL2 model family (#1300)

2023-11-09 18:55:09 +01:00

qwen2_moe.rs

Add argsort. (#2132)

2024-04-27 20:17:35 +02:00

qwen2.rs

fix: qwen2 lm_head loading #2443 (#2445)

2024-08-23 16:50:02 +02:00

recurrent_gemma.rs

Add a quantized version of recurrent-gemma. (#2054)

2024-04-13 20:07:01 +02:00

repvgg.rs

Add RepVGG model. (#1561)

2024-01-11 07:07:40 +01:00

resnet.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

rwkv_v5.rs

add quantized rwkv v5 model (#1743)

2024-02-25 21:43:40 +01:00

rwkv_v6.rs

add models of rwkv v6 and quantized rwkv v6 (#1781)

2024-03-01 08:37:56 +01:00

segformer.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

stable_lm.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

starcoder2.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00

t5.rs

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

trocr.rs

Support sinusoidal embeddings in trocr. (#1690)

2024-02-10 15:17:51 +01:00

vgg.rs

Fix the fast bf16 gemm cublas kernels. (#2274)

2024-06-18 23:46:58 +02:00

vit.rs

Use the repo config for trocr rather than hardcoding it + small tweaks. (#1689)

2024-02-10 13:15:03 +01:00

with_tracing.rs

Use the faster rms-norm kernel for llama. (#2107)

2024-04-22 18:52:00 +02:00

yi.rs

Use cat for faster MQA computation. (#2043)

2024-04-12 09:15:10 +02:00