huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
382c6b51af46f3906a191435d198f404f66de95e
candle/candle-flash-attn/kernels
History
Laurent Mazare 30cdd769f9 Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
..
alibi.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
block_info.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
dropout.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
error.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_api.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim32_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim32_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim32_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim32_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim64_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim64_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim64_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim64_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim96_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim96_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim96_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim96_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim128_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim128_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim128_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim128_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim160_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim160_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim160_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim160_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim192_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim192_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim192_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim192_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim224_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim224_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim224_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim224_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim256_bf16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim256_bf16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim256_fp16_causal_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_hdim256_fp16_sm80.cu
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_kernel.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash_fwd_launch_template.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
flash.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
kernel_helpers.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
kernel_traits_sm90.h
chore: update flash attention kernels (#1518)
2024-01-05 18:28:55 +01:00
kernel_traits.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
kernels.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
mask.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
philox.cuh
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
rotary.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
softmax.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
static_switch.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00
utils.h
Update the flash attn kernels. (#2333)
2024-07-15 20:37:36 +02:00