9aca398a4f
More accelerate optimizations ( #427 )
...
* Add more tracing to the whisper example.
* Support accelerate in more examples.
* Use accelerate for pointwise functions.
* Use accelerate for binary operations too.
* Bugfix for binary operation: use the rhs before the lhs.
2023-08-13 12:53:34 +01:00
60cd1551ca
Add a KV cache to whisper. ( #426 )
2023-08-12 21:17:08 +01:00
a0908d212c
Add a -language argument. ( #425 )
2023-08-12 17:08:40 +01:00
0741ebbd51
More multilingual support for whisper. ( #419 )
...
* More multilingual support for whisper.
* Use the language token appropriately.
2023-08-12 15:32:52 +01:00
0c3f109faa
Basic multilingual support for whisper ( #417 )
...
* Multi-lingual support for whisper.
* Avoid hardcoding the token names.
* More multi-lingual support.
* Remove the todo.
2023-08-12 11:23:04 +01:00
91dbf907d3
Add more whisper variants. ( #413 )
2023-08-11 17:33:55 +01:00
c3a0761e62
Add some tracing to the whisper example. ( #375 )
2023-08-09 19:58:36 +01:00
a3b1699409
Embed the mel filters in the whisper binary. ( #373 )
2023-08-09 18:27:26 +01:00
3eb2bc6d07
Softmax numerical stability. ( #267 )
...
* Softmax numerical stability.
* Fix the flash-attn test.
2023-07-28 13:13:01 +01:00
ca479a873e
Upgrading hf-hub to 0.2.0 (Modified API to not pass the Repo around
...
all the time)
2023-07-27 20:05:02 +02:00
209f06d7c3
Micro-cleanup. ( #256 )
2023-07-27 07:55:54 +01:00
43c7223292
Rename the .r functions to .dims so as to be a bit more explicit. ( #220 )
2023-07-22 10:39:27 +01:00
9515e8ea6c
Merge branch 'main' into remove_wrapper
2023-07-19 18:53:55 +02:00
dfd624dbd3
[Proposal] Remove SafeTensor wrapper (allows finer control for users).
2023-07-19 16:25:44 +02:00
439321745a
Removing candle-hub internal to extract into hf-hub standalone.
2023-07-19 15:04:38 +02:00
66750f9827
Add some 'cuda-if-available' helper function. ( #172 )
2023-07-15 08:25:15 +01:00
4ed56d7861
Removing cuda default.
...
Seems very important for a lot of exploring users usually on laptop
without GPUs.
Adding more README instructions in a follow up.
2023-07-14 16:52:15 +02:00
50b0946a2d
Tensor mutability ( #154 )
...
* Working towards tensor mutability.
* Use a ref-cell to provide tensor mutability.
2023-07-13 11:04:40 +01:00
eae646d322
Use arange in the examples. ( #146 )
2023-07-12 12:12:34 +01:00
b46c28a2ac
VarBuilder path creation ( #131 )
...
* Use a struct for the safetensor+routing.
* Group the path and the var-builder together.
* Fix for the empty path case.
2023-07-10 22:37:34 +01:00
1aa7fbbc33
Move the var-builder in a central place. ( #130 )
2023-07-10 20:49:50 +01:00
89a5b602a6
Move the conv1d layer to candle_nn. ( #117 )
2023-07-10 11:02:06 +01:00
b06e1a7e54
[nn] Move the Embedding and Activation parts. ( #116 )
...
* Share the Embedding and Activation parts.
* Tweak some activations.
2023-07-10 10:24:52 +01:00
9ce0f1c010
Sketch the candle-nn crate. ( #115 )
...
* Sketch the candle-nn crate.
* Tweak the cuda dependencies.
* More cuda tweaks.
2023-07-10 08:50:09 +01:00
c187f347bf
Make it easier to use whisper samples from the repo. ( #112 )
...
* Make it easier to use samples from the repo.
* Use f32 for accumulation in the f16/bf16 kernels.
2023-07-08 18:48:27 +01:00
115629fe08
Creating new sync Api for candle-hub.
...
- `api::Api` -> `api::tokio::api` (And created new `api::sync::Api`).
- Remove `tokio` from all our examples.
- Using similar codebase for now instead of ureq (for simplicity).
2023-07-06 15:15:25 +02:00
c297a50960
Add mkl support for matrix multiply. ( #86 )
...
* Fix some rebase issues.
* Use mkl instead.
* Use mkl in bert.
* Add the optional mkl feature.
* Conditional compilation based on the mkl feature.
* Add more mkl support.
2023-07-06 11:05:05 +01:00
cd230d26fe
Whisper tweaks ( #85 )
...
* Isolate the decoding bits of the whisper example.
* Decode -> Decoder.
* Add the suppress tokens filter.
* More suppress tokens.
2023-07-06 09:13:20 +01:00
d3418f1cff
Add the original whisper names as comment.
2023-07-06 07:57:03 +01:00
19ab5ea411
Merge pull request #78 from LaurentMazare/whisper_update
...
Adapting whisper for Hub use.
2023-07-06 07:21:58 +01:00
2c3d871b2e
Add a simpler way to specify the dim index for some ops.
2023-07-05 20:22:43 +01:00
653c5049f8
Adding auto download of audio file.
2023-07-05 15:21:53 +00:00
e85573a4bd
Adapting whisper for Hub use.
2023-07-05 14:35:27 +00:00
bae6d07b7e
Fix the position embeddings size.
2023-07-05 13:43:34 +01:00
d560855c2a
Bugfix for the mel filters.
2023-07-05 12:56:04 +01:00
63e5a266bf
Put everything together.
2023-07-05 12:19:21 +01:00
95f378ebb4
Read wav files.
2023-07-05 11:53:58 +01:00
26d1a7803f
Load the mel filters.
2023-07-05 11:20:33 +01:00
c701ee33a7
Add the mel filters.
2023-07-05 11:05:08 +01:00
648d1511d5
PCM conversion.
2023-07-05 11:02:49 +01:00
dd1d55f5c7
Mel spectogram computation.
2023-07-05 10:49:37 +01:00
f4c8a196a8
Mel spectogram.
2023-07-05 10:14:20 +01:00
7a6bc6d2dc
Mel spectogram computation (fft bits).
2023-07-05 09:54:12 +01:00
a824c5c3e3
Populate the no-speech probability.
2023-07-05 08:54:04 +01:00
9694e35db0
Clean the decode loop of the whisper example.
2023-07-05 08:37:26 +01:00
3ba4bfc501
More pretty printing.
2023-07-05 05:50:33 +01:00
8cf803d1a3
Split the model in a separate file.
2023-07-05 05:46:53 +01:00
9fe7a42895
More whisper sampling.
2023-07-04 22:18:07 +01:00
80f25e6fbb
More decoding.
2023-07-04 21:43:20 +01:00
babf3b4065
Sketch the decode step for whisper.
2023-07-04 18:25:47 +01:00
