Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
S
Stable Diffusion Webui
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Locked Files
Issues
0
Issues
0
List
Boards
Labels
Service Desk
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Security & Compliance
Security & Compliance
Dependency List
License Compliance
Packages
Packages
List
Container Registry
Analytics
Analytics
CI / CD
Code Review
Insights
Issues
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
novelai-storage
Stable Diffusion Webui
Commits
87dd6852
Commit
87dd6852
authored
May 21, 2023
by
brkirch
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
Make sub-quadratic the default for MPS
parent
abfa4ad8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
2 deletions
+5
-2
modules/sd_hijack_optimizations.py
modules/sd_hijack_optimizations.py
+5
-2
No files found.
modules/sd_hijack_optimizations.py
View file @
87dd6852
...
@@ -95,7 +95,10 @@ class SdOptimizationSdp(SdOptimizationSdpNoMem):
...
@@ -95,7 +95,10 @@ class SdOptimizationSdp(SdOptimizationSdpNoMem):
class
SdOptimizationSubQuad
(
SdOptimization
):
class
SdOptimizationSubQuad
(
SdOptimization
):
name
=
"sub-quadratic"
name
=
"sub-quadratic"
cmd_opt
=
"opt_sub_quad_attention"
cmd_opt
=
"opt_sub_quad_attention"
priority
=
10
@
property
def
priority
(
self
):
return
1000
if
shared
.
device
.
type
==
'mps'
else
10
def
apply
(
self
):
def
apply
(
self
):
ldm
.
modules
.
attention
.
CrossAttention
.
forward
=
sub_quad_attention_forward
ldm
.
modules
.
attention
.
CrossAttention
.
forward
=
sub_quad_attention_forward
...
@@ -121,7 +124,7 @@ class SdOptimizationInvokeAI(SdOptimization):
...
@@ -121,7 +124,7 @@ class SdOptimizationInvokeAI(SdOptimization):
@
property
@
property
def
priority
(
self
):
def
priority
(
self
):
return
1000
if
not
torch
.
cuda
.
is_available
()
else
10
return
1000
if
shared
.
device
.
type
!=
'mps'
and
not
torch
.
cuda
.
is_available
()
else
10
def
apply
(
self
):
def
apply
(
self
):
ldm
.
modules
.
attention
.
CrossAttention
.
forward
=
split_cross_attention_forward_invokeAI
ldm
.
modules
.
attention
.
CrossAttention
.
forward
=
split_cross_attention_forward_invokeAI
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment