huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-18 03:28:50 +00:00
Code Issues Packages Projects Releases Wiki Activity

Cuda support for embedding f16.

Browse Source
This commit is contained in:
laurent
2023-06-26 21:58:15 +01:00
parent becb822ce0
commit d204f1c7c0
2 changed files with 5 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
kernels/src/embeddings.cu
View File

@ -29,6 +29,10 @@ extern "C" __global__ void FN_NAME( \
} \
} \
#if __CUDA_ARCH__ >= 530
EMB_OP(__half, emb_f16)
#endif
EMB_OP(float, emb_f32)
EMB_OP(double, emb_f64)
EMB_OP(uint32_t, emb_u32)