pickle
with built in compression with Python Standard Library bz2
with no dependencies. Useful for serializing massive Dict objects, CSV files or NetworkX graphs and many more.
pip install kraut
from kraut import write_compressed, read_compressed
my_huge_data_object = {...}
write_compressed("save/myobj.pkl.bz2", my_huge_data_object):
...
my_restored_object = read_compressed("save/myobj.pkl.bz2"):
assertEqual(my_huge_data_object, my_restored_object)