Laurent Mazare 1e26d539d9 Improved mamba model optimized for inference (#1694) ...

* Sketch the mamba model for inference.

* Complete the forward pass.

* Add the mamba example.

* Optimize the selective-scan part.

* Fix a couple shape mismatches and get inference to work.

* Tweak the readmes.

* More readme tweaks.

2024-02-11 17:04:57 +01:00

..

bert

Speed up bert with approx gelu (#1410)

2023-12-06 17:46:37 +01:00

bigcode

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

blip

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

chatglm

Add the custom tokenizer. (#1686)

2024-02-09 17:36:50 +01:00

convmixer

Convmixer example (#1074)

2023-10-11 19:51:10 +01:00

convnext

Add ConvNeXt model. (#1604)

2024-02-03 13:34:28 +01:00

custom-ops

Metal: f16 and bf16 where_cond + benchmark (#1545)

2024-01-12 11:18:11 +01:00

dinov2

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

distilbert

Distibert (#1366)

2023-11-24 15:09:14 +00:00

efficientnet

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

falcon

Use the new hub helper function. (#1484)

2023-12-26 09:44:30 +01:00

jina-bert

Use the hub model file when possible. (#1190)

2023-10-26 20:00:50 +01:00

llama

fix index_pos bug when kv cache is disabled. (#1517)

2024-01-06 11:43:01 +01:00

llama2-c

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

llama_multiprocess

Use the new hub helper function. (#1484)

2023-12-26 09:44:30 +01:00

mamba

Improved mamba model optimized for inference (#1694)

2024-02-11 17:04:57 +01:00

mamba-minimal

Improved mamba model optimized for inference (#1694)

2024-02-11 17:04:57 +01:00

marian-mt

Add a KV cache to marian decoding. (#1226)

2023-10-31 08:47:44 +00:00

mistral

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

mixtral

Helper function to load sharded safetensors files (#1481)

2023-12-25 21:49:21 +01:00

mnist-training

Allow for different behavior between training and eval (#1213)

2023-10-29 07:53:09 +01:00

mobileone

Add MobileOne model. (#1595)

2024-01-16 06:34:16 +01:00

musicgen

Fix lints for clippy 1.75. (#1494)

2023-12-28 20:26:20 +01:00

onnx

Update docs to reflect current usage of example (#1610)

2024-02-04 11:59:47 +01:00

phi

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

quantized

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

quantized-t5

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

qwen

Fixing the qwen tokenizer location. (#1693)

2024-02-11 08:52:36 +01:00

reinforcement-learning

Add Policy Gradient to Reinforcement Learning examples (#1500)

2023-12-30 09:01:29 +01:00

replit-code

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

repvgg

Mention VGG in the readme. (#1573)

2024-01-12 09:59:29 +01:00

resnet

Expose the larger resnets (50/101/152) in the example. (#1131)

2023-10-19 13:48:28 +01:00

segment-anything

Add negative prompts to segment-anything. (#1000)

2023-09-30 06:17:42 +01:00

stable-diffusion

Format properly the Stable Diffusion example run with params (#1511)

2024-01-01 11:13:35 +01:00

stable-lm

Quantized support for stable-lm2. (#1654)

2024-02-04 11:57:05 +01:00

t5

Helper function to load sharded safetensors files (#1481)

2023-12-25 21:49:21 +01:00

trocr

docs: add trocr examples (#1692)

2024-02-10 16:14:50 +01:00

vgg

Allow for different behavior between training and eval (#1213)

2023-10-29 07:53:09 +01:00

vit

Readme updates. (#1134)

2023-10-20 09:08:39 +01:00

whisper

Supports more audio formats (#1628)

2024-02-03 14:26:04 +01:00

wuerstchen

Remove some unusued bits. (#1067)

2023-10-09 19:49:57 +01:00

yi

Fix token generation in bilingual models (non-English outputs) (#1668)

2024-02-06 12:03:53 +01:00

yolo-v3

Fix clippy lints for 1.76. (#1682)

2024-02-08 16:48:47 +01:00

yolo-v8

Fix linspace implementation (#1358)

2023-11-23 07:35:13 +00:00

onnx_basics.rs

[ONNX] Support a couple more ops. (#1284)

2023-11-06 22:44:58 +01:00