Laurent Mazare 0eb90ed783 Simpler repro for the neon optimization issue + bugfix (#1544) ...

* Simpler repro for the neon optimization issue.

* Bugfix for q4k.

* Improve the fix, share the dot-prod bit.

* Clippy fixes.

* Fix for q6k.

* Also fix for q2k.

* Use the new shared dotprod.

* Add more testing.

2024-01-07 20:21:49 +01:00

..

avx.rs

Fix a couple typos (#1451)

2023-12-17 05:20:05 -06:00

ggml_file.rs

Avoid some overflows on wasm32. (#968)

2023-09-26 11:15:38 +01:00

gguf_file.rs

Fix the quantized mistral example. (#1478)

2023-12-25 09:31:24 +01:00

k_quants.rs

No need for the even constraint on vecdot-q40-q80. (#1202)

2023-10-28 07:23:59 +01:00

mod.rs

Implement the module trait directly for QMatMul. (#1372)

2023-11-25 10:09:45 +00:00

neon.rs

Simpler repro for the neon optimization issue + bugfix (#1544)

2024-01-07 20:21:49 +01:00

simd128.rs

No need for the even constraint on vecdot-q40-q80. (#1202)

2023-10-28 07:23:59 +01:00

utils.rs

Use the gelu-erf activation. (#969)

2023-09-26 22:30:21 +01:00