Commits · ebb032d8f273d8bd9800419fde479ec55be783b2 · novelai-storage / Basedformer

15 Sep, 2022 1 commit
- sharding and epoch support with global shuffle · ebb032d8
  kurumuz authored Sep 14, 2022
  
  ebb032d8
13 Sep, 2022 1 commit
- update · 1f2c39ba
  kurumuz authored Sep 12, 2022
  
  1f2c39ba
27 Aug, 2022 3 commits
- smh · f7c8c4fe
  kurumuz authored Aug 26, 2022
  
  f7c8c4fe
- terrible hack :? · 6a53993a
  kurumuz authored Aug 26, 2022
  
  6a53993a
- make DSinference work with basedformer · c20db765
  kurumuz authored Aug 26, 2022
  
  c20db765
19 Jul, 2022 8 commits
- Fix output location and add `shuffle` parameter. · 6ccb1e1f
  Wes Brown authored Jul 19, 2022
  
  6ccb1e1f
- Adjust default batch size to 1. · 80b80fad
  Wes Brown authored Jul 18, 2022
  
  80b80fad
- Add docker image builder script. · fe34cc23
  Wes Brown authored Jul 18, 2022
  
  fe34cc23
- Fix wandb reporting, do first zero-eval *before* evaluating the first step. · 9240d7ea
  Wes Brown authored Jul 18, 2022
  
  9240d7ea
- Small fixes and updates. · 60893ad7
  Wes Brown authored Jul 18, 2022
  
  60893ad7
- First pass at argo workflow. · 3b759040
  Wes Brown authored Jul 18, 2022
  
  3b759040
- Add defaults, project id, logs. · 0bde514b
  Wes Brown authored Jul 18, 2022
  
  0bde514b
- Prompt updates, sampling configuration, and report in `tokens` space. · 2db358ff
  Wes Brown authored Jul 18, 2022
  
  2db358ff
18 Jul, 2022 3 commits
- Save a checkpoint at the end of every epoch. · bd34e4d4
  Wes Brown authored Jul 18, 2022
  
  bd34e4d4
- Epoch support, and mask `<|endoftext|>` · 55a00bbf
  Wes Brown authored Jul 17, 2022
  
  55a00bbf
- Add `--shuffle` argument, default to `False`. · eebb1fa8
  Wes Brown authored Jul 17, 2022
  
  eebb1fa8
16 Jul, 2022 1 commit
- hypertrain reporting fixes and improvements · ea32d948
  Wes Brown authored Jul 15, 2022
  
  ea32d948
15 Jul, 2022 6 commits
- Set default to `2049` and correctly calculate the tokens per second. · 94c0ad6f
  Wes Brown authored Jul 14, 2022
  
  94c0ad6f
- Fix shuffling and use provided context size on CLI. · 53bcc538
  Wes Brown authored Jul 14, 2022
  
  53bcc538
- Merge pull request #9 from NovelAI/os.changes · 6c1a2d67
  Eren Doğan authored Jul 14, 2022
  
  6c1a2d67
- Fix passing step to wandb. · 9fc1cc21
  Wes Brown authored Jul 14, 2022
  
  9fc1cc21
- Actually use the `lm_path` config option. · b4bf88c8
  Wes Brown authored Jul 14, 2022
  
  b4bf88c8
- Small fixes. · aa35ad92
  Wes Brown authored Jul 14, 2022
  
  aa35ad92
14 Jul, 2022 4 commits
- Revert mostly to `x=` assignment form. · 8b26deda
  Wes Brown authored Jul 13, 2022
  
  8b26deda
- Add argument handling, a closured `hypernetwork_saver`, and save the final result. · 8073ccfc
  Wes Brown authored Jul 13, 2022
  
  8073ccfc
- Clean up, better reporting. · 704947b4
  Wes Brown authored Jul 13, 2022
  
  704947b4
- Some cleanup, device agnosticism. · cc02ad48
  Wes Brown authored Jul 13, 2022
  
  cc02ad48
08 Jul, 2022 5 commits
- Merge pull request #8 from NovelAI/datasetfixes · 91470a5a
  Eren Doğan authored Jul 08, 2022
  
  91470a5a
- Don't check if identity is dict · b1e335ec
  novelailab authored Jul 08, 2022
  
  b1e335ec
- Danbooru id as identity · dad308db
  novelailab authored Jul 08, 2022
  
  dad308db
- Revert open() changes, fix and switch to build() · 7b770017
  novelailab authored Jul 08, 2022
  
  7b770017
- ImageDataset fixes, scrape and benchmark scripts · 8a038aec
  novelailab authored Jul 08, 2022
  
  8a038aec
07 Jul, 2022 4 commits
- fucked up · 0c96e233
  Eren Doğan authored Jul 06, 2022
  
  0c96e233
- more checks · 7e9cc877
  Eren Doğan authored Jul 06, 2022
  
  7e9cc877
- more dataset stuff · 690dd2cf
  Eren Doğan authored Jul 06, 2022
  
  690dd2cf
- zero2 works · fb134d28
  novelailab authored Jul 06, 2022
  
  fb134d28
06 Jul, 2022 4 commits
- experimental fused softmax support · 9d27a5cc
  novelailab authored Jul 06, 2022
  
  9d27a5cc
- add fusedad, fix bug in hypertrain, add setup pkgs · 7e2ee30f
  novelailab authored Jul 05, 2022
  
  7e2ee30f
- update hypetrain with API changes · 94ad5ad7
  novelailab authored Jul 05, 2022
  
  94ad5ad7
- push image fixes and builder example(not done) · 5a4b10c7
  novelailab authored Jul 05, 2022
  
  5a4b10c7