Laurent Mazare af7f8b87d3 Custom op for RmsNorm (#1890) ...

* Trying out a custom RmsNorm cuda kernel.

* CPU implementation for rms-norm.

* Cuda wrappers.

* Add some validation.

* Add some testing.

* More testing.

2024-03-21 06:36:28 +01:00

..

affine.cu

Cuda backend optimization (#1886)

2024-03-20 18:32:55 +01:00

binary_op_macros.cuh

Cuda backend optimization (#1886)

2024-03-20 18:32:55 +01:00

binary.cu

Add support for i64 (#563)

2023-08-23 10:42:19 +01:00

cast.cu

Cuda backend optimization (#1886)

2024-03-20 18:32:55 +01:00

compatibility.cuh

Compat windows.

2023-08-10 17:46:47 +02:00

conv.cu

ConvTranspose1d cuda support. (#1697)

2024-02-12 15:03:18 +01:00

cuda_utils.cuh

Add the rounding operators. (#1030)

2023-10-04 17:58:44 +01:00

fill.cu

Optimize the cat operation on contiguous tensors (#1855)

2024-03-17 10:49:13 +01:00

indexing.cu

fix: fix index_select cuda kernel for src target dim different than ids dim when selecting dim > 0 (#1037)

2023-10-05 18:46:13 +01:00

lib.rs

Cuda acceleration for quantized model. (#1754)

2024-02-25 18:11:47 +01:00

quantized.cu

Add a cuda kernel for dequantizing q8_0. (#1804)

2024-03-05 09:50:37 +01:00

reduce.cu

Custom op for RmsNorm (#1890)

2024-03-21 06:36:28 +01:00

ternary.cu

Add support for i64 (#563)

2023-08-23 10:42:19 +01:00

unary.cu

Cuda backend optimization (#1886)

2024-03-20 18:32:55 +01:00