You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
_get_shelf in pdsfile.py is sorting the pickle files as they are read because they are coming in out of order. But Python 3 stores dictionaries in insertion order, so we need to investigate why the pickle files are out of order. It could just be that some of the files are old and were written with Python 2, in which case we can update the pickle files and remove the sort.
The text was updated successfully, but these errors were encountered:
All of the shelf directories appear to have been updated since early 2021. We could start by choosing some of the oldest pickle files, reading them in, and checking whether they are already sorted.
Some old pickle files like ones created in 2020 doesn't have sorted keys, for example: 'holdings/_infoshelf-archives-volumes/COISS_3xxx_info.pickle'
For ones created in 2021, they will have sorted keys, for example: 'holdings/_infoshelf-archives-volumes/COISS_0xxx_info.pickle' and 'holdings/_infoshelf-archives-volumes/HSTJx_xxxx_info.pickle', we can remove the sorting at line 5085 of _get_shelf function in pdsfile.py if all the shelf files are generated after 2021.
From rms-webtools created by rfrenchseti: SETI/rms-webtools#30
_get_shelf in pdsfile.py is sorting the pickle files as they are read because they are coming in out of order. But Python 3 stores dictionaries in insertion order, so we need to investigate why the pickle files are out of order. It could just be that some of the files are old and were written with Python 2, in which case we can update the pickle files and remove the sort.
The text was updated successfully, but these errors were encountered: