Continue after the ingestion of a product fails

[tdddblog]

🗒️ Summary

Continue ingesting other products after the ingestion of a product fails.

NOTE: Valid use cases:

• If you are ingesting a directory (<directories> configuration) or a manifest (<files> configuration), Harvest will continue after any product failure.
• If you are ingesting a bundle (<bundles> configuration), Harvest will stop if the bundle or a collection ingestion fails. It will continue if any non-bundle or non-collection product type fails, such as an Observational product.

⚙️ Test Data and/or Report

• Build commons project first (see Continue after the ingestion of a product fails registry-common#23)
• Then build Harvest
• Before ingesting data make one or more products invalid. For example, set <start_date_time> = "ABC" or <field_number> = "XYZ".
• Run Harvest (use -O (overwrite) flag if you loaded the same data before)
• Check that products with errors are skipped and valid products are loaded. See NOTE above for valid use cases.

♻️ Related Issues

nasa-pds-engineering-node/pds-registry-app#253
#84