Kyle Birnbaum eb478ece92 Implementing DistilBertForMaskedLM. (#2866) ...

* Initial commit: model weights working, prediciton incorrect

* moved distilbertformaskedlm into distilbert modeling file

* made maskedLM like bert example, still incorrect predictions

* finally not getting NaNs, fixed attention mask

* getting correct output sentences

* get top k predictions

* fixed output formatting slightly

* added default arg for model_id

* lint

* moved masked token example code from distilbertformaskedlm example to distilbert example

* lint

* removed distilbertformaskedlm example

* cleanup

* clippy

* removed embedding normalization from example

* made output and model dependent on args instead of prompt

* lint

* replaced or_ok anyhow error with anyhow context

* changed error message for mask token not found

2025-04-11 13:25:39 +02:00

..

chinese_clip

Fix hardcoded f32 dtype for attention_mask. Use the model dtype for compatibility. (#2872)

2025-04-08 06:12:14 +02:00

clip

Add a Context trait similar to anyhow::Context. (#2676)

2024-12-22 09:18:13 +01:00

flux

Fix for clippy 1.86. (#2864)

2025-04-03 19:38:27 +02:00

llava

Add a Context trait similar to anyhow::Context. (#2676)

2024-12-22 09:18:13 +01:00

mimi

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

mmdit

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

nvembed_v2

Add Nvembed v2 model (#2649)

2024-12-03 10:56:01 +01:00

openclip

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

pixtral

Fix position encodings for Pixtral (#2678)

2024-12-23 13:22:35 +01:00

segment_anything

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

stable_diffusion

UniPC for diffusion sampling (#2684)

2025-01-01 21:34:17 +01:00

whisper

Fix for clippy 1.86. (#2864)

2025-04-03 19:38:27 +02:00

wuerstchen

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

based.rs

Module Docs (#2620)

2024-11-16 09:09:17 +01:00

beit.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

bert.rs

Fix hardcoded f32 dtype for attention_mask. Use the model dtype for compatibility. (#2872)

2025-04-08 06:12:14 +02:00

bigcode.rs

Module Docs (#2620)

2024-11-16 09:09:17 +01:00

blip_text.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

blip.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

chatglm.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

codegeex4_9b.rs

fix: fix the codegeex4 model examples and transformers model (#2738)

2025-01-25 17:41:12 +01:00

colpali.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

convmixer.rs

Lint fixes introduced with Rust 1.83 (#2646)

2024-11-28 23:00:21 +01:00

convnext.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

csm.rs

Add the CSM model. (#2862)

2025-04-04 06:48:03 +02:00

dac.rs

Add the SNAC audio tokenizer. (#2869)

2025-04-06 22:15:36 +02:00

debertav2.rs

Adds DebertaV2/V3 (#2743)

2025-01-29 08:59:28 +01:00

deepseek2.rs

Implement DeepSeek V2 (#2744)

2025-02-19 10:51:01 +01:00

depth_anything_v2.rs

make DepthAnythingV2 more reusable (#2675)

2024-12-21 12:06:03 +01:00

dinov2.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

dinov2reg4.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

distilbert.rs

Implementing DistilBertForMaskedLM. (#2866)

2025-04-11 13:25:39 +02:00

efficientnet.rs

Add a Context trait similar to anyhow::Context. (#2676)

2024-12-22 09:18:13 +01:00

efficientvit.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

encodec.rs

Add the SNAC audio tokenizer. (#2869)

2025-04-06 22:15:36 +02:00

eva2.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

falcon.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

fastvit.rs

Add a Context trait similar to anyhow::Context. (#2676)

2024-12-22 09:18:13 +01:00

gemma2.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

gemma3.rs

Gemma 3 initial setup (text only). (#2802)

2025-03-14 07:56:02 +01:00

gemma.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

glm4.rs

fix: fix the codegeex4 model examples and transformers model (#2738)

2025-01-25 17:41:12 +01:00

granite.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

helium.rs

Add the helium model. (#2715)

2025-01-13 17:39:49 +01:00

hiera.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

jina_bert.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

llama2_c_weights.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

llama2_c.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

llama.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

mamba.rs

Fix for clippy 1.86. (#2864)

2025-04-03 19:38:27 +02:00

marian.rs

Added new language pairs to marian-mt example. (#2860)

2025-04-02 23:50:14 +02:00

metavoice.rs

Fix for clippy 1.86. (#2864)

2025-04-03 19:38:27 +02:00

mistral.rs

Fix mistral attention on Metal (#2699)

2025-01-04 16:11:20 +01:00

mixformer.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

mixtral.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

mobileclip.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

mobilenetv4.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

mobileone.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

mod.rs

Add the SNAC audio tokenizer. (#2869)

2025-04-06 22:15:36 +02:00

modernbert.rs

Add ModernBert sentency classifier (#2796)

2025-03-08 14:48:22 +01:00

moondream.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

mpt.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

olmo.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

paligemma.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

parler_tts.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

persimmon.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

phi3.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

phi.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

quantized_blip_text.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_blip.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_llama2_c.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_llama.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

quantized_metavoice.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_mistral.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_mixformer.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_moondream.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_mpt.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_phi3.rs

Fixes for running Phi-4 quantized. (#2714)

2025-01-13 14:35:33 +01:00

quantized_phi.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_qwen2.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_recurrent_gemma.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_rwkv_v5.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_rwkv_v6.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_stable_lm.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

quantized_t5.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

qwen2_moe.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

qwen2.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

recurrent_gemma.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

repvgg.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

resnet.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

rwkv_v5.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

rwkv_v6.rs

More Model Module Docs (#2623)

2024-11-17 20:27:24 +01:00

segformer.rs

Add a Context trait similar to anyhow::Context. (#2676)

2024-12-22 09:18:13 +01:00

siglip.rs

Parse the json config for siglip models. (#2800)

2025-03-09 14:01:09 +01:00

snac.rs

Add the SNAC audio tokenizer. (#2869)

2025-04-06 22:15:36 +02:00

stable_lm.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

starcoder2.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

stella_en_v5.rs

Adds support for stella_en_v5 embedding model -400M variant (#2608)

2024-11-29 09:01:08 +01:00

t5.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00

trocr.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

vgg.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

vit.rs

Documentation Pass for Models (#2617)

2024-11-15 08:30:15 +01:00

with_tracing.rs

Use the faster rms-norm kernel for llama. (#2107)

2024-04-22 18:52:00 +02:00

xlm_roberta.rs

Added XLMRobertaModel for Reranking (#2686)

2024-12-30 11:16:57 +01:00

yi.rs

Module Docs (#2624)

2024-11-18 14:19:23 +01:00