Implement reindexing sweeper #155
Conversation
this currently yields strange results which may indicate that OS/python are inconsistent in their lexical sorting
…dest This avoids issues where ES/python have inconsistent lexical sort approaches
TODO: implement argparse CLI
without this in place prior to migration, the reindexer sweeper will fail
… documents this is a bandaid, but should be replaced by detection/handling of "RequestError(400, 'illegal_argument_exception', 'ReleasableBytesStreamOutput cannot hold more than 2GB of data'" such that
…me resolution and all calls
this was removed during rebase/merge in d0b85a5
alexdunnjpl
requested review from
tloubrieu-jpl,
nutjob4life and
collinss-jpl
as code owners
There was a problem hiding this comment.
The pull request still has boilerplate:
One of the following should be included here:
Reference to regression test included in code (preferred wherever reasonable)
Attach test data here + outputs of tests
Any of those outputs available to replace the boilerplate?
I tried running the tests myself with tox -e py39 but got 4 failed, 39 passed, 120 warnings, 8 errors so I might be running them wrong 🤷
Sorry, meant to open this as a draft PR - will update and re-request review later |
|
@alexdunnjpl no worries! Converted to "draft". Thanks! |
…nant_index_name()
|
🗒️ Summary
Implements reindexing sweeper/script
Implements support for aliased indices in all sweepers code
⚙️ Test Data and/or Report
One of the following should be included here:
♻️ Related Issues
Related to NASA-PDS/registry#339 (comment)
Related to NASA-PDS/registry#329
Related to NASA-PDS/registry#338