Commit Graph

30 Commits

Author SHA1 Message Date
117f014b55 Add where_cond and properly apply the causal mask. 2023-06-25 21:08:03 +01:00
3852a85af3 Boilerplate code for the sum operator. 2023-06-25 09:35:17 +01:00
6b2cd9c51c Add the broadcast operator. 2023-06-24 19:16:03 +01:00
dd657397b2 Skeleton implementation for the narrow method and op. 2023-06-24 08:17:35 +01:00
5d44e76e3f Add the casting operation. 2023-06-23 21:22:07 +01:00
8ed350dc94 Add a couple unitary ops. 2023-06-23 20:19:20 +01:00
fe75a01188 Cleanup the tensor creation code. 2023-06-23 19:52:21 +01:00
4f9f14a06b Optimize the cpu backend for the contiguous cases. 2023-06-23 18:08:55 +01:00
4c8931d2e4 More u32 support. 2023-06-23 14:54:03 +01:00
08394f7924 Binary op for u32. 2023-06-23 14:50:52 +01:00
92da45879c Dummy broadcast placeholder functions. 2023-06-23 14:07:05 +01:00
7c1625f6a5 Merge pull request #6 from LaurentMazare/add_embedding
Adding embedding op (not generic gather, no select).
2023-06-23 13:49:13 +02:00
5e54f37fe1 Adding embedding op (not generic gather, no select). 2023-06-23 13:13:26 +02:00
56ae71dd4c Address comments. 2023-06-23 13:08:04 +02:00
fd21c708ab Creating Gelu op (no backward). 2023-06-23 13:07:39 +02:00
79e4b29c2f Add the reshape method and operation (without grad for now). 2023-06-23 10:51:05 +01:00
c4c6167949 Add the continuous method. 2023-06-23 10:45:20 +01:00
6110db31c9 Add the cat operator (without the storage implementation for now). 2023-06-23 10:13:37 +01:00
3e7cb18d7f Handle tensor transfers between devices in the backprop. 2023-06-23 08:55:34 +01:00
3f79d81b6f Add transposition around arbitrary axis. 2023-06-23 08:51:13 +01:00
27d428af1a Add the backward pass for transpose. 2023-06-23 08:43:05 +01:00
fc41ccb5bb Add the copy method. 2023-06-23 08:12:52 +01:00
836ad5f76c Remove one level of indirection for the binary and unary ops. 2023-06-22 15:20:51 +01:00
ce977b489e Adding matmul? 2023-06-22 12:25:58 +02:00
78bac0ed32 Add a couple operators. 2023-06-20 22:32:11 +01:00
f1f372b13e Add the affine transformation. 2023-06-20 21:51:35 +01:00
c4c303b6f1 Add some very basic backprop. 2023-06-20 20:33:44 +01:00
d9cb1917ce Add some unary ops. 2023-06-20 12:04:01 +01:00
8e2c534d1f Flesh out some ops bits. 2023-06-19 19:28:33 +01:00
ce718bb807 Add the op. 2023-06-19 18:34:54 +01:00