Thomas Santerre 0067fe00a8 Metal Unary: Add benchmarks and process kernels in a tile based fashion (#2056) ...

* add basic unary bench for sqrt

* process unary commands in tiles of 4

* re-enable all benchmarks

* rename helper to unary

* modify approach to split up tiled and non-tiled operations

* undo bench ignore for other tests

* update tile size to 2

* only perform the optimization on the contiguous even numbered element case

2024-04-21 00:10:33 +02:00

..

affine.metal

Optimize the cat operation on contiguous tensors (#1855)

2024-03-17 10:49:13 +01:00

binary.metal

update dtypes checks for several metal operations (#2010)

2024-04-04 18:39:06 +02:00

cast.metal

add support for casting between all datatypes (#1860)

2024-03-17 20:55:11 +01:00

conv.metal

Extend supported dtypes for metal (im2col & upsample_2d) (#1938)

2024-03-26 06:48:56 +01:00

indexing.metal

Support gather on bf16 for metal. (#2035)

2024-04-10 12:49:25 +02:00

lib.rs

Metal Unary: Add benchmarks and process kernels in a tile based fashion (#2056)

2024-04-21 00:10:33 +02:00

libMetalFlashAttention.metallib

chore: final

2024-01-22 15:15:19 +00:00

quantized.metal

Quantized GGUF style (#1523)

2024-01-17 10:27:58 +01:00

random.metal

Metal random-generation bug fixes (#1811)

2024-03-08 16:11:50 +01:00

reduce.metal

Add the rope THD kernel. (#2014)

2024-04-05 08:32:58 +02:00

ternary.metal

Metal: f16 and bf16 where_cond + benchmark (#1545)

2024-01-12 11:18:11 +01:00

tests.rs

Use BufferOffset in metal backend ops. (#2029)

2024-04-08 09:37:25 +02:00

unary.metal

Metal Unary: Add benchmarks and process kernels in a tile based fashion (#2056)

2024-04-21 00:10:33 +02:00

utils.rs

Rework the buffer offset logic for metal kernels (#2028)

2024-04-07 22:37:53 +02:00