• Brendan Hoar's avatar
    Better handling of embeddings with two rare, but not unusual, files in them · c5ae2254
    Brendan Hoar authored
    I have encountered pickled embeddings with a short byteorder file at the top-level, as well as a .data/serialization_id file.
    
    Both load fine after allowing these files in the dataset.
    
    I do not think it is likely adding them to the safe unpickle regular expression would be a security risk, but that's for the maintainers to decide.
    c5ae2254
safe.py 6.92 KB