If you're pickling that much data you should definitely consider using a more appropriate data format. Maybe a database or HDF5?
If you're pickling that much data you should definitely consider using a more appropriate data format. Maybe a database or HDF5?