• AngelBottomless's avatar
    Weight initialization and More activation func · de096d0c
    AngelBottomless authored
    add weight init
    
    add weight init option in create_hypernetwork
    
    fstringify hypernet info
    
    save weight initialization info for further debugging
    
    fill bias with zero for He/Xavier
    
    initialize LayerNorm with Normal
    
    fix loading weight_init
    de096d0c
ui.py 2.16 KB