Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
S
Stable Diffusion Webui
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Locked Files
Issues
0
Issues
0
List
Boards
Labels
Service Desk
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Security & Compliance
Security & Compliance
Dependency List
License Compliance
Packages
Packages
List
Container Registry
Analytics
Analytics
CI / CD
Code Review
Insights
Issues
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
novelai-storage
Stable Diffusion Webui
Commits
f9c5da15
Commit
f9c5da15
authored
Oct 08, 2022
by
AUTOMATIC
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add fallback for xformers_attnblock_forward
parent
a5550f02
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
modules/sd_hijack_optimizations.py
modules/sd_hijack_optimizations.py
+4
-1
No files found.
modules/sd_hijack_optimizations.py
View file @
f9c5da15
...
...
@@ -211,6 +211,7 @@ def cross_attention_attnblock_forward(self, x):
return
h3
def
xformers_attnblock_forward
(
self
,
x
):
try
:
h_
=
x
h_
=
self
.
norm
(
h_
)
q1
=
self
.
q
(
h_
)
.
contiguous
()
...
...
@@ -218,4 +219,6 @@ def xformers_attnblock_forward(self, x):
v
=
self
.
v
(
h_
)
.
contiguous
()
out
=
xformers
.
ops
.
memory_efficient_attention
(
q1
,
k1
,
v
)
out
=
self
.
proj_out
(
out
)
return
x
+
out
return
x
+
out
except
NotImplementedError
:
return
cross_attention_attnblock_forward
(
self
,
x
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment