Laurent Mazare 0ace420e66 Flash attention without padding (varlen). (#281) ...

* Expose the seqlen variable for flash-attn without padding.

* Fix the batched call.

* Adapt for the varlen variant.

* No need to set the batch strides when in varlen mode.

* Add a test (disabled at the moment).

* Get the test to work properly.

2023-07-31 09:45:39 +01:00

..

flash_attn_tests.rs

Flash attention without padding (varlen). (#281)

2023-07-31 09:45:39 +01:00