Laurent Mazare 2d5f2a728d Add the RWKV model (v5). (#1707) ...

* Start adding the RWKV model.

* More of the forward step.

* Handle rescaling.

* FeedForward.

* More work on RWKV.

* Better state tracking.

* Finish a first pass on forward.

* Fix the shape mismatches.

* Do not rescale in f32.

* Rename to rwkv-v5.

* Add the new models to the readme.

2024-02-14 10:58:32 +01:00

..

segment_anything

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

stable_diffusion

Fix a couple typos (#1451)

2023-12-17 05:20:05 -06:00

whisper

feat: support microphone whisper streaming (#1678)

2024-02-12 18:01:21 +01:00

wuerstchen

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

bert.rs

Use candle_nn::embedding instead of local copies in a few models. (#1562)

2024-01-10 21:36:27 +01:00

bigcode.rs

Use candle_nn::embedding instead of local copies in a few models. (#1562)

2024-01-10 21:36:27 +01:00

blip_text.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

blip.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

chatglm.rs

Add the ChatGLM model. (#1237)

2024-02-09 11:51:38 +01:00

convmixer.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

convnext.rs

Add ConvNeXt-V2 and smaller model variants. (#1709)

2024-02-14 10:53:07 +01:00

dinov2.rs

Move more models to candle-transformers (#796)

2023-09-10 10:20:18 +01:00

distilbert.rs

Distibert (#1366)

2023-11-24 15:09:14 +00:00

efficientnet.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

falcon.rs

Use candle_nn::embedding instead of local copies in a few models. (#1562)

2024-01-10 21:36:27 +01:00

jina_bert.rs

Fixes for jina-bert. (#1189)

2023-10-26 18:52:30 +01:00

llama2_c_weights.rs

Move the llama2-c model in transformers. (#1205)

2023-10-28 16:51:19 +01:00

llama2_c.rs

Infer the config for llama2-c. (#1208)

2023-10-28 19:00:39 +01:00

llama.rs

Add the RWKV model (v5). (#1707)

2024-02-14 10:58:32 +01:00

mamba.rs

Improved mamba model optimized for inference (#1694)

2024-02-11 17:04:57 +01:00

marian.rs

Remove the unused pragma for marian. (#1236)

2023-11-01 20:04:52 +00:00

mistral.rs

add config_amazon_mistral_lite (#1493)

2023-12-28 19:59:58 +01:00

mixformer.rs

Update mixformer.rs (#1601)

2024-02-03 13:42:16 +01:00

mixtral.rs

Add the Mixtral model. (#1437)

2023-12-15 14:19:56 -06:00

mobileone.rs

Add MobileOne model. (#1595)

2024-01-16 06:34:16 +01:00

mod.rs

Add the RWKV model (v5). (#1707)

2024-02-14 10:58:32 +01:00

mpt.rs

Make some model cloneable. (#1125)

2023-10-18 19:30:47 +01:00

persimmon.rs

Add the relu2 and relu6 activations. (#1201)

2023-10-27 20:51:16 +01:00

phi.rs

Fix the rotary embeddings for the new phi implementation. (#1582)

2024-01-13 19:44:41 +01:00

quantized_blip_text.rs

Add a quantized blip model. (#1155)

2023-10-22 20:33:25 +01:00

quantized_blip.rs

[Wasm] BLIP Example (#1183)

2023-10-26 07:24:02 +01:00

quantized_llama2_c.rs

Move the llama2-c model in transformers. (#1205)

2023-10-28 16:51:19 +01:00

quantized_llama.rs

Fixing quantized llama demo on metal. (#1703)

2024-02-13 16:28:56 +01:00

quantized_mistral.rs

feat: add clear_kv_cache to mistral and qmistral models (#1464)

2023-12-21 21:19:19 +01:00

quantized_mixformer.rs

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

quantized_mpt.rs

More model cloning. (#1126)

2023-10-18 21:55:46 +01:00

quantized_stable_lm.rs

Quantized support for stable-lm2. (#1654)

2024-02-04 11:57:05 +01:00

quantized_t5.rs

Add support to UL2 model family (#1300)

2023-11-09 18:55:09 +01:00

qwen2.rs

Add the Qwen2 model (#1684)

2024-02-09 15:02:49 +01:00

repvgg.rs

Add RepVGG model. (#1561)

2024-01-11 07:07:40 +01:00

resnet.rs

Do not implement Module for BatchNorm. (#1513)

2024-01-01 10:13:13 +01:00

rwkv_v5.rs

Add the RWKV model (v5). (#1707)

2024-02-14 10:58:32 +01:00

stable_lm.rs

Add StableLM-2, StableLM Code and Zephyr variants (#1650)

2024-02-03 14:58:41 +01:00

t5.rs

Add min to buckets in relative_position_bucket (#1312)

2023-11-10 11:57:25 +01:00

trocr.rs

Support sinusoidal embeddings in trocr. (#1690)

2024-02-10 15:17:51 +01:00

vgg.rs

Allow for different behavior between training and eval (#1213)

2023-10-29 07:53:09 +01:00

vit.rs

Use the repo config for trocr rather than hardcoding it + small tweaks. (#1689)

2024-02-10 13:15:03 +01:00

with_tracing.rs

Share the layer-norm implementation. (#1248)

2023-11-03 06:30:05 +01:00

yi.rs

Use the llama weight names for the Yi example. (#1381)

2023-11-27 20:42:52 +00:00