Laurent Mazare 36cf54525d Fix the fast bf16 gemm cublas kernels. (#2274) ...

* Use flash-attn in gemma.

* Fix for the fast bf16 cublas gemm.

* Fix some clippy lints.

* Fix another lint.

* Proper clippy fix.

2024-06-18 23:46:58 +02:00

..

basics.rs

Implement the module trait directly for QMatMul. (#1372)

2023-11-25 10:09:45 +00:00

cuda_basics.rs

Fix the fast bf16 gemm cublas kernels. (#2274)

2024-06-18 23:46:58 +02:00

cuda_sum_benchmark.rs

More accelerate optimizations (#427)

2023-08-13 12:53:34 +01:00