Laurent Mazare 06207332bc Streaming mode for reporting the generated tokens (#1007) ...

* Token streaming.

* Use the token output stream.

* Flush the output.

* Ensure that the last characters get reported.

2023-09-30 15:04:11 +01:00

..

bert

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

bigcode

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

custom-ops

Remove some dead-code annotations. (#629)

2023-08-27 18:52:33 +01:00

dinov2

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

efficientnet

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

falcon

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

llama

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

llama2-c

Implement top_p / nucleus sampling (#819)

2023-09-12 18:10:16 +02:00

llama_multiprocess

Self-contained safetensors for the multiprocess llama example. (#950)

2023-09-24 06:54:49 +01:00

mistral

Streaming mode for reporting the generated tokens (#1007)

2023-09-30 15:04:11 +01:00

mnist-training

Add the optimizer trait. (#702)

2023-09-01 12:55:39 +01:00

musicgen

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

phi

Mistral: exit on eos token. (#1001)

2023-09-30 07:07:06 +01:00

quantized

Add a gif to the quantized readme. (#833)

2023-09-13 08:43:52 +01:00

quantized-t5

Add more quantized flan t5 variants (#923)

2023-09-21 13:23:30 +01:00

segment-anything

Add negative prompts to segment-anything. (#1000)

2023-09-30 06:17:42 +01:00

stable-diffusion

Use the module trait in stable-diffusion. (#817)

2023-09-11 20:40:07 +01:00

t5

Self-contained safetensor wrappers (#946)

2023-09-23 20:39:52 +01:00

whisper

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

wuerstchen

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

yolo-v3

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00

yolo-v8

Adapt more examples to the updated safetensor api. (#947)

2023-09-23 21:26:03 +01:00