huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-21 04:10:46 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add back the bf16 flash-attn kernels. (#730)

Browse Source
This commit is contained in:
Laurent Mazare
2023-09-04 08:50:52 +02:00
committed by GitHub
parent 20512ba408
commit d0cdea95a5
4 changed files with 25 additions and 22 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
candle-flash-attn/src/ffi.rs
View File

@ -38,6 +38,7 @@ extern "C" {
seqlen_k_rounded: u32,
is_causal: c_int,
is_bf16: c_int,
);
}