Re: [igraph] Error pickling (very) large graphs: OSError: [Errno 22] Invalid argument

[Tamas Nepusz]

Hi,

Thanks Tamas! I had no idea that pickling was less efficient than a string format -- I'd assumed the efficiencies of storing in binary trumped the issues with references.

It's more efficient space-wise but probably less efficient time-wise and in terms of peak memory usage (due to the reference checking). it is up to you to decide which ones costs more in the long run. JSON does not have to check references but it wastes space on the disk, so that's why running it through gzip is probably a good idea.

T.