Laurent Mazare 7ebc3548e1 Use flash-attn in gemma. (#2195) ...

* Use flash-attn in gemma.

* Fix flash-attn for head dim 256.

2024-05-18 19:18:59 +02:00

..

alibi.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

block_info.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_api.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim32_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim32_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim64_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim64_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim96_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim96_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim128_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim128_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim160_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim160_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim192_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim192_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim224_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim224_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim256_bf16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_hdim256_fp16_sm80.cu

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_kernel.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

flash_fwd_launch_template.h

Use flash-attn in gemma. (#2195)

2024-05-18 19:18:59 +02:00

flash.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

kernel_traits_sm90.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

kernel_traits.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

philox.cuh

Add flash attention (#241)

2023-07-26 07:48:10 +01:00

softmax.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00

static_switch.h

Add flash attention (#241)

2023-07-26 07:48:10 +01:00

utils.h

chore: update flash attention kernels (#1518)

2024-01-05 18:28:55 +01:00