2341aa079e
Fix quantized zephyr chat prompt ( #1314 ) ( #1317 )
...
* Fix quantized zephyr chat prompt (#1314 )
* Avoid using a mutable variable.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com >
2023-11-11 09:14:12 +01:00
9e666d4229
Add the var method. ( #1315 )
...
* Add the var method.
* Add a test.
2023-11-10 22:47:57 +01:00
1b12142a02
Add min to buckets in relative_position_bucket ( #1312 )
2023-11-10 11:57:25 +01:00
d2c3f14773
Fix for flash-attn. ( #1310 )
...
Co-authored-by: laurent <laurent@par2dc5-ai-prd-cl01dgx02.cm.cluster >
2023-11-10 10:27:27 +01:00
26c4e5bf1d
Metal part 1 - Scaffolding for metal. ( #1308 )
...
* Metal part 1 - Scaffolding for metal.
* Remove tracing.
2023-11-10 08:35:48 +01:00
18d30005c5
Add support to UL2 model family ( #1300 )
...
* Add support to UL2 model family
* Update docs with UL2
* Create ActivationWithOptionalGating to avoid polluting activations
* Also refactor quantized t5
* Remove useless conversion
* Revert Activation::NewGelu name change
* Remove useless return
* Apply rustfmt and clippy recommendations
* Reuse t5::ActivationWithOptionalGating in quantized version
* (cosmetic change) use a match rather than ifs + avoid early returns.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com >
2023-11-09 18:55:09 +01:00
6958384327
Add support for TrOCR Model ( #1303 )
...
* add bce with logit loss
* add bce with logit loss
* remove imports
* fix tiny bug
* add test documentation and refactor function
* fix test cases and formatting
* add trocr model
* fix formatting
* commit the actual model lol
* more formatting
* remove tokenizer config
2023-11-09 18:49:17 +01:00
e6697471bb
Add weight and bias functions to LayerNorm ( #1306 )
2023-11-09 16:09:01 +01:00
73d02f4f57
fix: negative axis ( #1296 )
...
* fix: negative axis
* Use normalize_axis.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com >
2023-11-08 23:28:21 +01:00
f772213e84
Fix bug introduced in madlad PR ( #1298 )
2023-11-08 17:55:46 +01:00
2feb0b054f
Add the mel filters for 128 bins. ( #1295 )
2023-11-08 08:23:53 +01:00
2d28497197
Preliminary support for whisper v3. ( #1294 )
...
* Preliminary support for whisper v3.
* Add the missing files.
2023-11-08 06:42:52 +01:00
f3a4f3db76
PyO3: Add optional candle.onnx module ( #1282 )
...
* Start onnx integration
* Merge remote-tracking branch 'upstream/main' into feat/pyo3-onnx
* Implement ONNXModel
* `fmt`
* add `onnx` flag to python ci
* Pin `protoc` to `25.0`
* Setup `protoc` in wheel builds
* Build wheels with `onnx`
* Install `protoc` in manylinux containers
* `apt` -> `yum`
* Download `protoc` via bash script
* Back to `manylinux: auto`
* Disable `onnx` builds for linux
2023-11-08 06:37:50 +01:00
7920b45c8a
Support for timegroupnorm in encodec. ( #1291 )
2023-11-07 22:39:59 +01:00
d4a45c936a
Quantized model small tweaks ( #1290 )
...
* Support the shape op in ONNX.
* Share the axis normalization bits.
* Add some limited support for gather.
* Unsqueeze.
* Comparison with broadcasting.
* Add Not + handle i32.
* Tweaks for the quantized model.
2023-11-07 21:21:37 +01:00
c912d24570
Update README: Move T5 to Text to Text section ( #1288 )
...
I think it makes more sense to have it there, since it's a seq2seq model with cross attention, and not a LM. There are also Decoder only T5 models that work as LMs, but that's not the standard.
2023-11-07 16:14:04 +01:00
d5c2a7b64b
Add info about MADLAD-400 in readme files ( #1287 )
2023-11-07 15:21:59 +01:00
508f811b93
Add support for MADLAD400 ( #1285 )
...
* Add support for madlad
* Add support for quantized MADLAD
2023-11-07 05:35:37 +01:00
a773a4b22b
[ONNX] Support a couple more ops. ( #1284 )
...
* Support the shape op in ONNX.
* Share the axis normalization bits.
* Add some limited support for gather.
* Unsqueeze.
* Comparison with broadcasting.
* Add Not + handle i32.
2023-11-06 22:44:58 +01:00
5a363dbc26
Adds check for 7b-zephyr and uses correct template ( #1283 )
...
* Adds check for 7b-zephyr and uses correct template
* Handle zephyr as mistral.
* Disable the protoc bits of the CI.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com >
2023-11-06 21:05:39 +01:00
abc4f698c5
Add candle-sampling ( #1278 )
2023-11-06 12:53:29 +01:00
a923e8b53a
Add a link to candle-ext to README.md ( #1277 )
2023-11-06 12:44:39 +01:00
2a45bcf943
Put the onnx example behind a feature flag. ( #1276 )
...
* Put the onnx example behind a feature flag.
* Exclude the onnx bits from the workspace.
* README tweaks.
2023-11-06 07:45:07 +01:00
47f4ddb011
Added info about missing protoc ( #1275 )
...
Co-authored-by: figgefigge <fredric.1337mail.com>
2023-11-06 06:47:32 +01:00
f365a075e5
Add more models to the onnx example. ( #1273 )
...
* Add more models to the onnx example.
* Input validation.
* Input validation.
* Bugfix.
* Implement clip.
* BatchNorm support.
* Get the efficientnet onnx to work.
2023-11-05 16:57:26 +01:00
60fdab4e17
Detach all grads during backprop. ( #1243 )
...
* Detach all grads during backprop.
* Add an environment variable to select the backprop behavior.
* Update the comment.
2023-11-05 14:07:41 +01:00
928a9d906e
[ONNX] Do not generate values for constants. ( #1272 )
...
* Do not generate values for constants.
* Add an onnx based example using squeezenet.
2023-11-05 11:23:14 +01:00
d1d89bac1f
feat: download cifar dataset parquet files ( #1259 )
2023-11-05 10:55:49 +01:00
39ad840a90
Better tensor initialization in ONNX. ( #1270 )
...
* Better tensor initialization in ONNX.
* MaxPool support.
* Add AvgPool.
* Get the squeezenet example to work.
2023-11-04 22:17:45 +01:00
b5e4f84bed
Refactor the onnx attribute getters. ( #1268 )
...
* Refactor the onnx attribute getters.
* Add get-attr-opt.
* Add support for convolutions.
* Add support for convolutions.
2023-11-04 21:31:48 +01:00
7051fb8098
feat: add backprop for elu ( #1269 )
...
* feat: add backprop for elu
* Cosmetic tweaks.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com >
2023-11-04 21:26:41 +01:00
dc68c130e4
Support more ONNX ops. ( #1267 )
...
* Add LogSoftmax.
* Support for Transpose.
2023-11-04 15:10:14 +01:00
bc9a1bf239
Improve the ONNX basic example + bugfixes ( #1266 )
...
* Generate some zeros tensor in the onnx simple-eval example.
* Fix the casting operation.
* Support more ops.
* Handle reshape.
* Concat.
* Softmax.
2023-11-04 10:02:47 +01:00
f7c957d64f
ONNX casting support. ( #1265 )
...
* ONNX casting support.
* Handle tensor constants.
* Bugfix the binary ops.
2023-11-04 08:34:24 +01:00
8cbb9d0e6c
Add some preliminary ONNX support ( #1260 )
...
* Add the onnx protos.
* Move the reading bits.
* Install protoc on the CI.
* Install protoc on the cuda CI too.
* Use clap for the onnx tool.
* Tweak the CI protoc install.
* Add some simple evalution function.
* Add some binary operator support.
2023-11-04 06:36:05 +01:00
bfe95115c6
Update README.md ( #1264 )
2023-11-04 05:32:32 +01:00
6fa3151820
Allow using gguf-v3 files. ( #1262 )
2023-11-03 23:07:53 +01:00
0a58886ccb
add distil-whisper link ( #1261 )
2023-11-03 21:34:42 +01:00
3173b1ce3b
feat: impl backprop for erf and gelu-erf ( #1258 )
...
* impl backprop for erf anf gelu-erf
* feat: unary tests added for erf and gelu-erf
* fix: (clippy) remove immediately dereferenced ref
* fix: improve comments with pytorch code snippet
* fix: adjust comment typo in backprop impl
2023-11-03 21:32:30 +01:00
ad63f20781
add Kalosm to the list of external resources ( #1257 )
2023-11-03 19:16:46 +01:00
1cfc5d6d0c
Backprop support for conv1d (cpu only for now). ( #1255 )
2023-11-03 14:23:53 +01:00
b07b2350b6
Test for the transposed conv1d. ( #1254 )
2023-11-03 13:10:28 +01:00
1b5063f3ca
Add vllm external resource ( #1253 )
2023-11-03 12:40:31 +01:00
3b0d1e7d03
Transposed conv1d in candle-nn. ( #1252 )
2023-11-03 11:18:25 +01:00
be4555c5a5
Add the conv-transpose1d op. ( #1251 )
...
* Skeleton structure for conv-transpose1d.
* CPU implementation for conv-transpose1d.
2023-11-03 09:44:46 +01:00
6975c65112
Share the layer-norm implementation. ( #1248 )
2023-11-03 06:30:05 +01:00
a2a20aeecc
Add the swiglu activation from the chatglm PR. ( #1246 )
2023-11-02 20:01:34 +01:00
e08fbb6543
Add support for distil whisper ( #1245 )
...
* Add support for distil-whisper.
* Add distil-large.
* Rename the large model.
2023-11-02 19:32:35 +01:00
d39d0c40fd
Add hard-sigmoid and hard-swish activations ( #1244 )
...
* Add hard-sigmoid and hard-swish activations
* Update ops.rs
* Use / rather than div.
---------
Co-authored-by: Laurent <laurent.mazare@gmail.com >
2023-11-02 18:20:27 +01:00
b97463098c
llama2-c wasm fix.
2023-11-02 10:31:47 +01:00
