Laurent Mazare 2ce5f12513 Again set a few extra params in flash-attn. (#245) ...

* Again set a few extra params.

* Use the appropriate kernel sizes.

* Add all the kernel sizes.

* Parallel compiling.

* Reduce the amount of parallelism.

* Add the missing kernel.

* Fix a typo.

* Remove bf16 support for now.

2023-07-26 14:16:37 +01:00

..

examples

Again set a few extra params in flash-attn. (#245)

2023-07-26 14:16:37 +01:00

src

Add some 'cuda-if-available' helper function. (#172)

2023-07-15 08:25:15 +01:00

build.rs

Add flash attention (#241)

2023-07-26 07:48:10 +01:00

Cargo.toml

Add flash attention (#241)

2023-07-26 07:48:10 +01:00