Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Sign in / Register
Toggle navigation
B
Basedformer
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Locked Files
Issues
0
Issues
0
List
Boards
Labels
Service Desk
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Security & Compliance
Security & Compliance
Dependency List
License Compliance
Packages
Packages
List
Container Registry
Analytics
Analytics
CI / CD
Code Review
Insights
Issues
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
novelai-storage
Basedformer
Commits
4a13de3a
Commit
4a13de3a
authored
Feb 20, 2022
by
novelailab
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
upload pyfra script
parent
6aa2089c
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
34 additions
and
0 deletions
+34
-0
test.py
test.py
+5
-0
test_pyfra.py
test_pyfra.py
+29
-0
No files found.
test.py
0 → 100644
View file @
4a13de3a
from
main
import
*
state_dict
=
SplitCheckpoint
(
"'/home/xuser/models/j6b_ckpt_14001"
,
device
=
"cuda"
)
for
x
in
state_dict
:
print
(
x
)
test_pyfra.py
0 → 100644
View file @
4a13de3a
from
novelutils.novelfra
import
*
from
pyfra
import
*
import
sys
name
=
'pyfra-basedformer'
dry
=
False
config_obj
=
KubeConfig
()
config_obj
.
set_name
(
name
)
config_obj
.
set_gpu
(
gpu_name
=
GPU
.
A40
,
amount
=
1
)
config_obj
.
set_ram
(
16
)
config_obj
.
set_cpu
(
4
)
#config_obj.set_cpu_only()
config_obj
.
dry_run
(
dry
)
config_obj
.
print_information
()
config_obj
.
create_deployment
(
overwrite
=
True
)
config_obj
.
create_service
(
overwrite
=
True
)
remote
=
config_obj
.
get_pyfra_remote
()
env1
=
remote
.
env
(
'noname'
,
python_version
=
None
)
models
=
{
'6b'
:
'/home/xuser/models/j6b_ckpt_14001'
,
'20b'
:
'/home/xuser/diffusionstorage/models/20B_136500.hf'
,
'13b'
:
'/home/xuser/diffusionstorage/workspace/finetune/pokepls/bigmodel'
}
path
=
env1
.
path
(
'/home/xuser/diffusionstorage/workspace/kuru/basedformer'
)
env1
.
sh
(
'pip install /home/xuser/hugessd/pytorch/torch-1.10.1+cu113-cp38-cp38-linux_x86_64.whl'
)
env1
.
sh
(
'pip install einops numpy'
)
with
always_rerun
():
path
.
sh
(
f
'python3 test.py'
)
\ No newline at end of file
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment