Commit Graph

2339 Commits

Author SHA1 Message Date
30b355ccd2 Simplify the narrow implementation. 2023-06-28 13:09:59 +01:00
c1bbbf94f6 Start refactoring the stride. 2023-06-28 12:57:30 +01:00
d461d9d751 Merge pull request #26 from LaurentMazare/narrow-grad
Add the grad for narrow.
2023-06-28 11:46:13 +01:00
666d6dbcac Merge remote-tracking branch 'origin/main' into narrow-grad 2023-06-28 11:45:46 +01:00
2998ff6ef7 Merge pull request #25 from LaurentMazare/fix_hub
Fix flaky test ?
2023-06-28 12:42:38 +02:00
7938d2b848 Add the grad for narrow. 2023-06-28 10:46:00 +01:00
9c86e4afa8 Fix flaky test ? 2023-06-28 11:40:41 +02:00
d0ff3b2d13 Merge pull request #24 from LaurentMazare/more-grads
Support gradients for reshape and where_cond.
2023-06-28 10:04:51 +01:00
615196e7be Add more gradients. 2023-06-28 09:59:52 +01:00
50eff0005b Merge pull request #23 from LaurentMazare/relu
Add the relu op.
2023-06-28 09:44:24 +01:00
1ce3843cab Add the relu op. 2023-06-28 09:38:54 +01:00
b805c4114b Merge pull request #22 from LaurentMazare/more-cuda-testing2
Again more cuda testing.
2023-06-28 09:01:25 +01:00
19183b8e4f Factor out the gemm bits. 2023-06-28 08:51:13 +01:00
0417d9cec8 Add more cuda testing again. 2023-06-28 08:33:43 +01:00
64c6bc4f5e Merge pull request #21 from LaurentMazare/more-cuda-tests
Also run the backprop tests on cuda.
2023-06-28 08:19:01 +01:00
395c84e80a Also run the backprop tests on cuda. 2023-06-28 08:15:03 +01:00
a457020d50 Merge pull request #20 from LaurentMazare/tensor-display
Add some pretty print display to Tensors
2023-06-27 21:53:09 +01:00
b0f5f2d22d Add some display tests + bugfixes. 2023-06-27 21:37:28 +01:00
8c81a70170 PyTorch like display implementation. 2023-06-27 21:16:35 +01:00
934655a60d Add squeeze/unsqueeze/stack. 2023-06-27 19:32:00 +01:00
1d504cc6b3 Rework the debug trait. 2023-06-27 19:10:30 +01:00
d28bf64ed6 Merge pull request #18 from LaurentMazare/tensor-helper
Add some helper functions
2023-06-27 17:43:04 +01:00
684f66326d Add the get method. 2023-06-27 17:39:58 +01:00
c44e5346f4 Add some helper functions. 2023-06-27 17:37:09 +01:00
efc39b71c5 Merge pull request #17 from LaurentMazare/cuda-test-utils
Add some test utils module.
2023-06-27 16:24:04 +01:00
dbe3e4e7c0 Add some test utils module. 2023-06-27 16:20:28 +01:00
aa35c418a5 Merge pull request #16 from LaurentMazare/cuda-tests
Run the tensor tests for the cuda backend too.
2023-06-27 15:51:28 +01:00
47937650aa And add back some readme :) 2023-06-27 15:50:43 +01:00
e221d38819 Factor the slicing code in cuda. 2023-06-27 15:45:59 +01:00
07a682c2ff Run the tensor tests for the cuda backend too. 2023-06-27 15:37:01 +01:00
b3622c972f Merge pull request #15 from LaurentMazare/num-cpus
Use num-cpus to enable parallelism in matmul's cpu version.
2023-06-27 14:45:08 +01:00
ca6aa8ff12 Use num-cpus to enable parallelism. 2023-06-27 14:42:26 +01:00
64ae526af4 Merge pull request #11 from LaurentMazare/add_hub
Adding candle-hub
2023-06-27 15:37:52 +02:00
70a90a1465 Clippy without features. 2023-06-27 14:04:20 +02:00
75e0905832 Adding fully offline version. 2023-06-27 13:58:23 +02:00
1a82bc50c9 [Tmp] Adding candle-hub 2023-06-27 13:58:23 +02:00
8371890996 Merge pull request #12 from LaurentMazare/fix_ci
Does this prevent `candle-kernels` test suite from being run ?
2023-06-27 13:58:01 +02:00
c2edaf83eb Ignoring candle-kernels during CI. 2023-06-27 13:53:23 +02:00
140a8edf01 Merge pull request #14 from LaurentMazare/llama-opt
Cache the causal mask in llama.
2023-06-27 12:21:31 +01:00
318503cd38 Cache the causal mask in llama. 2023-06-27 12:21:08 +01:00
527a71fdad Merge pull request #13 from LaurentMazare/cuda-bugfixes
Fix two cuda bugs (matmul and where_cond).
2023-06-27 11:32:26 +01:00
380d61e990 Fix two cuda bugs (matmul and where_cond). 2023-06-27 11:31:04 +01:00
0fed864bbf Does this prevent candle-kernels test suite from being run ? 2023-06-27 12:14:53 +02:00
d7f729fb8f Refactor the hierarchy. 2023-06-27 11:57:27 +02:00
6c4a960b15 Embedding bugfix. 2023-06-27 09:56:19 +01:00
18707891b7 Fix an error message. 2023-06-27 09:45:38 +01:00
bb262ecc99 More casting kernels. 2023-06-27 09:36:35 +01:00
ee3d290f8b Cuda support for dtype conversions. 2023-06-27 09:15:46 +01:00
51640ba7e6 Merge pull request #10 from LaurentMazare/f16
Add support for f16 and bf16
2023-06-27 05:59:59 +01:00
e152c1273d Add more context for missing cuda kernels. 2023-06-27 05:56:19 +01:00