huggingface/candle
1
0
Fork 0
mirror of https://github.com/huggingface/candle.git synced 2025-06-16 18:48:51 +00:00
Code Issues Packages Projects Releases Wiki Activity

Mention the flash-attention restriction in the readme. (#1158)

Browse Source
This commit is contained in:
Laurent Mazare
2023-10-23 10:26:56 +01:00
committed by GitHub
parent a11af79e23
commit 25c3cc4149
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
candle-examples/examples/stable-diffusion/README.md
View File

@ -50,6 +50,9 @@ cached.
Enabling flash-attention requires both a feature flag, `--feature flash-attn` Enabling flash-attention requires both a feature flag, `--feature flash-attn`
and using the command line flag `--use-flash-attn`. and using the command line flag `--use-flash-attn`.
Note that flash-attention-v2 is only compatible with Ampere, Ada, or Hopper GPUs
(e.g., A100/H100, RTX 3090/4090).
## Image to Image Pipeline ## Image to Image Pipeline
... ...