huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-20 20:09:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add the bf16 cuda kernels.

Browse Source
This commit is contained in:
laurent
2023-06-29 23:12:02 +01:00
parent 018e017e7e
commit ec79fc43f2
9 changed files with 67 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
candle-kernels/src/ternary.cu
View File

@ -32,6 +32,10 @@ extern "C" __global__ void FN_NAME( \
} \
} \
#if __CUDA_ARCH__ >= 800
WHERE_OP(__nv_bfloat16, where_bf16)
#endif
#if __CUDA_ARCH__ >= 530
WHERE_OP(__half, where_f16)
#endif