1. 07 Jun, 2023 1 commit
    • Alexander Ljungberg's avatar
      Fix upcast attention dtype error. · d9cc0910
      Alexander Ljungberg authored
      Without this fix, enabling the "Upcast cross attention layer to float32" option while also using `--opt-sdp-attention` breaks generation with an error:
      
      ```
        File "/ext3/automatic1111/stable-diffusion-webui/modules/sd_hijack_optimizations.py", line 612, in sdp_attnblock_forward
          out = torch.nn.functional.scaled_dot_product_attention(q, k, v, dropout_p=0.0, is_causal=False)
      RuntimeError: Expected query, key, and value to have the same dtype, but got query.dtype: float key.dtype: float and value.dtype: c10::Half instead.
      ```
      
      The fix is to make sure to upcast the value tensor too.
      d9cc0910
  2. 05 Jun, 2023 1 commit
  3. 02 Jun, 2023 6 commits
  4. 01 Jun, 2023 10 commits
  5. 28 May, 2023 4 commits
  6. 23 May, 2023 2 commits
  7. 21 May, 2023 16 commits