Basic quantization support (#453)

Browse Source

* Add a vecdot trait.

* Start implementing mul_mat.

* Add to the mul mat implementation.

* Add q8_0 quantization.

* Implement the GgmlType trait for all types.

* Add the missing block.

* Add a TODO.

...

This commit is contained in:

Laurent Mazare

2023-08-15 15:53:19 +01:00

committed by GitHub

parent ebcfd96d94

commit 5e49922be2

1 changed files with 589 additions and 286 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

875

candle-core/src/ggml.rs

File diff suppressed because it is too large Load Diff