|
|
92da45879c
|
Dummy broadcast placeholder functions.
|
2023-06-23 14:07:05 +01:00 |
|
|
|
f8848db001
|
Fix the gelu kernel for f16.
|
2023-06-23 13:38:54 +01:00 |
|
|
|
db5526d51a
|
Merge pull request #8 from LaurentMazare/fix_cuda
Backport.
|
2023-06-23 14:27:01 +02:00 |
|
|
|
8add5a5f49
|
Backport.
|
2023-06-23 14:17:39 +02:00 |
|
|
|
7c1625f6a5
|
Merge pull request #6 from LaurentMazare/add_embedding
Adding embedding op (not generic gather, no select).
|
2023-06-23 13:49:13 +02:00 |
|
|
|
2fb87edda5
|
Address comments.
|
2023-06-23 13:43:18 +02:00 |
|
|
|
52c503ba8f
|
Handle the contiguous case in an optimized way when copying cpu memory.
|
2023-06-23 12:20:16 +01:00 |
|
|
|
d4054ab500
|
Merge pull request #5 from LaurentMazare/add_gelu
Creating Gelu op (no backward).
|
2023-06-23 13:17:37 +02:00 |
|
|
|
96289bce08
|
Rebase.
|
2023-06-23 13:17:21 +02:00 |
|
|
|
5e54f37fe1
|
Adding embedding op (not generic gather, no select).
|
2023-06-23 13:13:26 +02:00 |
|
|
|
09b7731b8d
|
Fix unary op.
|
2023-06-23 13:10:26 +02:00 |
|
|
|
56ae71dd4c
|
Address comments.
|
2023-06-23 13:08:04 +02:00 |
|
|
|
fd21c708ab
|
Creating Gelu op (no backward).
|
2023-06-23 13:07:39 +02:00 |
|
|
|
4ffdeb4e23
|
Optimize for the contiguous case.
|
2023-06-23 11:23:49 +01:00 |
|
|
|
1a90f9d3a6
|
Cuda implementation for copying data around.
|
2023-06-23 11:18:29 +01:00 |
|
|
|
79e4b29c2f
|
Add the reshape method and operation (without grad for now).
|
2023-06-23 10:51:05 +01:00 |
|
|
|
c4c6167949
|
Add the continuous method.
|
2023-06-23 10:45:20 +01:00 |
|
|
|
4712dcc2f6
|
Actually copy the data around in cat (cpu only).
|
2023-06-23 10:24:02 +01:00 |
|
|
|
6110db31c9
|
Add the cat operator (without the storage implementation for now).
|
2023-06-23 10:13:37 +01:00 |
|
|
|
bf9e1d1c23
|
Add the detach method.
|
2023-06-23 09:19:23 +01:00 |
|
|
|
3e7cb18d7f
|
Handle tensor transfers between devices in the backprop.
|
2023-06-23 08:55:34 +01:00 |
|
|
|
3f79d81b6f
|
Add transposition around arbitrary axis.
|
2023-06-23 08:51:13 +01:00 |
|
|
|
27d428af1a
|
Add the backward pass for transpose.
|
2023-06-23 08:43:05 +01:00 |
|
|
|
3b550a56dc
|
Transfer tensors between devices.
|
2023-06-23 08:35:22 +01:00 |
|
|
|
fc41ccb5bb
|
Add the copy method.
|
2023-06-23 08:12:52 +01:00 |
|
|
|
552276749a
|
Only keep track of the graph when needed.
|
2023-06-22 22:06:24 +01:00 |
|
|
|
fc83d97b41
|
Only support the contiguous case for cublas matmul.
|
2023-06-22 21:39:37 +01:00 |
|
|
|
2231c717d5
|
Fix the matmul example.
|
2023-06-22 21:11:41 +01:00 |
|
|
|
6463d661d8
|
Tweaks.
|
2023-06-22 20:25:14 +01:00 |
|
|
|
aebffcfc13
|
Add a matmul cuda example.
|
2023-06-22 19:44:26 +01:00 |
|
|
|
0671b8c369
|
Improve the gemm config.
|
2023-06-22 19:24:02 +01:00 |
|
|
|
cc78900922
|
Start adding the cublas based matmul.
|
2023-06-22 18:45:10 +01:00 |
|
|
|
683730c21d
|
Add the cublas handle to the cuda device.
|
2023-06-22 18:03:53 +01:00 |
|
|
|
7d9a8ff3f9
|
Do not ignore errors when cloning the storage.
|
2023-06-22 16:29:18 +01:00 |
|
|
|
2f7a072250
|
Rename as_slice to storage_data and implement the cuda version.
|
2023-06-22 16:00:22 +01:00 |
|
|
|
065b7a19c7
|
Stride support for unary ops.
|
2023-06-22 15:46:34 +01:00 |
|
|
|
5b1ab5b687
|
Support strides in affine.
|
2023-06-22 15:38:42 +01:00 |
|
|
|
836ad5f76c
|
Remove one level of indirection for the binary and unary ops.
|
2023-06-22 15:20:51 +01:00 |
|
|
|
5276755fb3
|
Add cuda support for unary ops.
|
2023-06-22 15:12:59 +01:00 |
|
|
|
b8f514d9c6
|
Add more binary kernels.
|
2023-06-22 14:07:02 +01:00 |
|
|
|
97fe1fac85
|
Add a makefile for cleaning the kernels code.
|
2023-06-22 13:57:51 +01:00 |
|
|
|
e1eb86db61
|
Add some first binary op (add).
|
2023-06-22 13:52:02 +01:00 |
|
|
|
83d6198009
|
Simplify the binary kernels.
|
2023-06-22 13:16:03 +01:00 |
|
|
|
4b1c3405e9
|
Add a couple cuda kernels from dfdx.
|
2023-06-22 12:56:29 +01:00 |
|
|
|
625e08d6ab
|
Abstract the implementation of Shape.
|
2023-06-22 12:39:15 +01:00 |
|
|
|
f052020ba2
|
Support cuda in to_vec3.
|
2023-06-22 12:22:51 +01:00 |
|
|
|
0689d62548
|
Merge pull request #2 from LaurentMazare/matmul
Adding matmul.
|
2023-06-22 13:18:57 +02:00 |
|
|
|
77712d4348
|
Addressing comments.
|
2023-06-22 13:13:35 +02:00 |
|
|
|
449af49b54
|
Adding size checking when creating a tensor from buffer + shape.
|
2023-06-22 13:08:57 +02:00 |
|
|
|
a8b6c848e0
|
Final updates.
|
2023-06-22 12:39:33 +02:00 |
|
