Commit Graph

536 Commits

Author SHA1 Message Date
fefdc0228a Fixing the cached build.
- rerun-if-change:src/ encapsulates any src modification (including file
  additions).
- Now not rewriting `src/lib.rs` everytime (it triggers new builds.)
- Also using modified timestamp to trigger kernel recompilation (should
  prevent skipping modified source files).
- Will also rewrite when a kernel is removed.
2023-07-05 18:12:17 +02:00
1db0fbee0d Merge pull request #80 from LaurentMazare/bert-avg-pool
Use avg pooling before the cosine similarity.
2023-07-05 17:06:40 +01:00
174e57d216 Use avg pooling before the cosine similarity. 2023-07-05 17:05:50 +01:00
a4a60a13fa Merge pull request #79 from LaurentMazare/bert-similarities
Add some sentence similarity comparison task to the bert example.
2023-07-05 16:51:25 +01:00
914e84deec Add some sentence similarity comparision to the bert example. 2023-07-05 16:49:57 +01:00
653c5049f8 Adding auto download of audio file. 2023-07-05 15:21:53 +00:00
e85573a4bd Adapting whisper for Hub use. 2023-07-05 14:35:27 +00:00
4e80319147 Merge pull request #77 from LaurentMazare/whisper-fix-emb
[whisper] Fix the position embeddings size.
2023-07-05 13:56:41 +01:00
bae6d07b7e Fix the position embeddings size. 2023-07-05 13:43:34 +01:00
e4fb8c45cc Merge pull request #69 from LaurentMazare/upgrade_bert
Upgrading bert example to work with `bert-base-uncased`.
2023-07-05 13:06:42 +01:00
93896f6596 Merge branch 'main' into upgrade_bert 2023-07-05 13:06:33 +01:00
bce28ab793 Merge pull request #76 from LaurentMazare/whisper-mel-bugfix
Bugfix for the mel filters in whisper.
2023-07-05 12:57:13 +01:00
d560855c2a Bugfix for the mel filters. 2023-07-05 12:56:04 +01:00
4df250cf37 Merge pull request #75 from LaurentMazare/whisper-mel
Whisper Mel spectogram computation
2023-07-05 12:21:13 +01:00
63e5a266bf Put everything together. 2023-07-05 12:19:21 +01:00
95f378ebb4 Read wav files. 2023-07-05 11:53:58 +01:00
26d1a7803f Load the mel filters. 2023-07-05 11:20:33 +01:00
c701ee33a7 Add the mel filters. 2023-07-05 11:05:08 +01:00
648d1511d5 PCM conversion. 2023-07-05 11:02:49 +01:00
dd1d55f5c7 Mel spectogram computation. 2023-07-05 10:49:37 +01:00
f4c8a196a8 Mel spectogram. 2023-07-05 10:14:20 +01:00
7a6bc6d2dc Mel spectogram computation (fft bits). 2023-07-05 09:54:12 +01:00
6a4297d77b Merge pull request #74 from LaurentMazare/whisper-cleanup
Clean the decode loop of the whisper example.
2023-07-05 08:55:48 +01:00
a824c5c3e3 Populate the no-speech probability. 2023-07-05 08:54:04 +01:00
d8f75ceeaa Some polish. 2023-07-05 07:41:14 +00:00
9694e35db0 Clean the decode loop of the whisper example. 2023-07-05 08:37:26 +01:00
963c75cb89 Adding offline mode. 2023-07-05 07:19:57 +00:00
fbdabf0325 Merge pull request #73 from LaurentMazare/to-scalar-bugfix
Bugfix for to_scalar (use the proper start offset).
2023-07-05 06:45:34 +01:00
6d1e79d378 Bugfix for to_scalar (use the proper start offset). 2023-07-05 06:42:29 +01:00
ad0666271d Merge pull request #72 from LaurentMazare/whisper-decode
More whisper decode
2023-07-05 05:53:53 +01:00
0cf096eb24 Merge pull request #71 from LaurentMazare/whisper-decode
Whisper decode
2023-07-05 05:52:50 +01:00
3ba4bfc501 More pretty printing. 2023-07-05 05:50:33 +01:00
8cf803d1a3 Split the model in a separate file. 2023-07-05 05:46:53 +01:00
9fe7a42895 More whisper sampling. 2023-07-04 22:18:07 +01:00
80f25e6fbb More decoding. 2023-07-04 21:43:20 +01:00
babf3b4065 Sketch the decode step for whisper. 2023-07-04 18:25:47 +01:00
9cebf07f0d Merge pull request #70 from LaurentMazare/whisper-mask
[whisper] Add the causal mask in text decoding.
2023-07-04 15:33:28 +01:00
31663bc04f Add the causal mask in text decoding. 2023-07-04 15:25:47 +01:00
43a007cba4 Upgrading bert example to work with bert-base-uncased.
- Always take weights from the hub
- Optional `model_id` + `revision` to use safetensors version
  potentially
- Optional loading for `bert-base-uncased` (`weight` vs `gamma`).
- Take the config from the hub.
2023-07-04 14:12:14 +00:00
04f4ef81e8 Merge pull request #68 from LaurentMazare/conv1d-stride-fix
Properly handle the stride in conv1d.
2023-07-04 15:07:36 +01:00
459e2e1ae3 Properly handle the stride in conv1d. 2023-07-04 15:05:04 +01:00
29a0330d6d Merge pull request #67 from LaurentMazare/whisper
Sketch the whisper model.
2023-07-04 14:39:25 +01:00
c3739d001b Get the audio-encoder to return some values. 2023-07-04 14:06:09 +01:00
b3d4d0fd0f Very inefficient conv1d implementation. 2023-07-04 13:50:41 +01:00
99b83773b5 Small cleanup. 2023-07-04 13:21:59 +01:00
599160605c Use the stored embeddings. 2023-07-04 13:13:28 +01:00
0d99b43792 Line up the textdecoder values with the python implementation. 2023-07-04 12:27:05 +01:00
aea090401d Run the text decoding bit. 2023-07-04 12:03:28 +01:00
950b4af49e Proper conv1d dispatch. 2023-07-04 11:29:28 +01:00
a424d95473 Add more of the conv1d op. 2023-07-04 11:15:45 +01:00