Laurent Mazare d01207dbf3 Add a RotatingKVCache. (#2493) ...

* Add a RotatingKVCache.

* Add some KvCache tests.

* Test the reset too.

* More kv-cache testing.

* More tests for the rotating kv-cache.

* Improve the api for the rotating cache so that the whole src tensor gets returned when it's overlarge.

* Handle contiguity + bugfix + use in mimi.

* Add a way to test the mimi streaming mode.

* Mimi streaming fixes.

* More rotating kv-cache.

* Fix the attn mask generation.

* Handle the abs case.

* Add some tests for the generated mask.

2024-09-23 13:14:32 +02:00

..

based

Add Based LLM from Hazy Research. (#2411)

2024-08-12 21:21:19 +02:00

beit

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

bert

bert attention mask (#1934)

2024-08-01 08:26:19 +02:00

bigcode

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

blip

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

chatglm

Add the custom tokenizer. (#1686)

2024-02-09 17:36:50 +01:00

clip

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

codegeex4-9b

feat(candle-transformers/models/codegeex4-9b): add codegeex4-9 (#2334)

2024-07-21 13:00:41 +02:00

convmixer

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

convnext

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

custom-ops

Cuda acceleration for quantized model. (#1754)

2024-02-25 18:11:47 +01:00

depth_anything_v2

Depth Anything v2 (#2279)

2024-06-24 19:12:52 +02:00

dinov2

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

dinov2reg4

Add DINOv2Reg4 + PlantCLEF2024 (#2293)

2024-06-29 11:49:15 +02:00

distilbert

Distibert (#1366)

2023-11-24 15:09:14 +00:00

efficientnet

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

efficientvit

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

encodec

Fix issues in the encodec example README.md (#2407)

2024-08-10 07:49:05 +02:00

eva2

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

falcon

Use the new hub helper function. (#1484)

2023-12-26 09:44:30 +01:00

fastvit

FastViT fixes. (#2452)

2024-08-28 11:20:09 +02:00

flux

Fix FLUX.1 weights (#2457)

2024-08-29 17:10:28 +02:00

gemma

Add support for gemma-2. (#2425)

2024-08-17 20:31:23 +02:00

glm4

add models support and example for THUDM/glm-4 (#2362)

2024-08-05 17:48:09 +02:00

granite

Adding Granite 7b Instruct model example (#2487)

2024-09-21 11:52:01 +02:00

gte-qwen

Support embedding model gte-Qwen1.5-7B-instruct (#2190)

2024-05-16 21:34:10 +02:00

hiera

Add Hiera vision model. (#2382)

2024-08-01 11:59:22 +02:00

jina-bert

Fix cargo fmt. (#2383)

2024-08-01 14:19:41 +02:00

llama

Add support for Llama 3.1 (#2359)

2024-07-26 21:32:26 +02:00

llama2-c

Explicit caching in llama2.c.

2024-02-22 10:22:03 +01:00

llama_multiprocess

Apply rustfmt. (#2421)

2024-08-16 18:57:14 +02:00

llava

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

mamba

Support alternative dtypes for mamba (#2036)

2024-04-10 18:10:01 +02:00

mamba-minimal

Improved mamba model optimized for inference (#1694)

2024-02-11 17:04:57 +01:00

marian-mt

Fix the marian tokenizer importer. (#2426)

2024-08-17 20:58:40 +02:00

metavoice

Quantized version of the metavoice model. (#1824)

2024-03-09 11:06:04 +01:00

mimi

Add a RotatingKVCache. (#2493)

2024-09-23 13:14:32 +02:00

mistral

Support for mistral-nemo. (#2396)

2024-08-04 19:52:40 +02:00

mixtral

Use BF16 on metal when possible. (#2378)

2024-08-01 10:48:58 +02:00

mnist-training

Allow for different behavior between training and eval (#1213)

2023-10-29 07:53:09 +01:00

mobileclip

MobileCLIP models S1 and S2 (#2454)

2024-08-29 15:38:58 +02:00

mobilenetv4

MobileCLIP models S1 and S2 (#2454)

2024-08-29 15:38:58 +02:00

mobileone

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

moondream

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

musicgen

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

olmo

Add Olmo models (#2127)

2024-04-26 11:02:51 +02:00

onnx

Update docs to reflect current usage of example (#1610)

2024-02-04 11:59:47 +01:00

parler-tts

Fix for parler-tts, do not add the last slice of padding tokens. (#2442)

2024-08-22 23:22:03 +02:00

phi

Enable BF16 on metal. (#2380)

2024-08-01 11:05:07 +02:00

quantized

Force the revision for the phi3-llama quantized models. (#2159)

2024-05-04 10:41:18 +02:00

quantized-phi

Simplify the KvCache api. (#2207)

2024-05-23 17:07:21 +02:00

quantized-qwen2-instruct

add quantized qwen2 (#2329)

2024-07-12 10:00:03 +02:00

quantized-t5

Move the tensor-tools binary in a separate crate. (#1969)

2024-03-30 15:49:37 +01:00

qwen

Support for the new Qwen2 models. (#2257)

2024-06-07 10:51:50 +01:00

recurrent-gemma

Add a quantized version of recurrent-gemma. (#2054)

2024-04-13 20:07:01 +02:00

reinforcement-learning

Update for pyo3 0.21. (#1985)

2024-04-01 17:07:02 +02:00

replit-code

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

repvgg

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

resnet

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

rwkv

Fix the model path for rwkv. (#1825)

2024-03-09 11:21:48 +01:00

segformer

Update the image crate + use the re-exported version. (#1893)

2024-03-21 10:56:41 +01:00

segment-anything

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

silero-vad

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

stable-diffusion

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

stable-lm

Avoid copying the data on squeeze and unsqueeze. (#1884)

2024-03-20 13:04:36 +01:00

starcoder2

Add the StarCoder2 model. (#1779)

2024-02-28 21:02:41 +01:00

t5

Expose the t5 config fields + allow t5-large. (#1987)

2024-04-01 20:58:34 +02:00

trocr

onnx: fix pad, unsqueeze (#2317)

2024-07-23 23:10:57 +02:00

vgg

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

vit

Move the image tensor to the appropriate device. (#1856)

2024-03-16 22:25:46 +01:00

whisper

whisper readme (#1899)

2024-03-21 12:54:09 +01:00

whisper-microphone

feat: support microphone whisper streaming (#1678)

2024-02-12 18:01:21 +01:00

wuerstchen

Remove some unusued bits. (#1067)

2023-10-09 19:49:57 +01:00

yi

Fix token generation in bilingual models (non-English outputs) (#1668)

2024-02-06 12:03:53 +01:00

yolo-v3

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

yolo-v8

Clippy fixes for 1.81.0. (#2461)

2024-09-05 23:46:55 +02:00

onnx_basics.rs

[ONNX] Support a couple more ops. (#1284)

2023-11-06 22:44:58 +01:00