[FEA] Specify recover_with_null
when reading JSON files
#9326
Labels
feature request
New feature or request
recover_with_null
when reading JSON files
#9326
Is your feature request related to a problem? Please describe.
cuDF recently added an option that we requested (PR), where we can specify a recovery mode of
recover_with_null
so that invalid lines in a newline-delimited JSON file produce NULL values rather than throwing an exception. This issue is for updating the plugin to use this new feature.Note that an initial attempt at implementing this uncovered some edge cases that need addressing in cuDF:
Describe the solution you'd like
Specify this new option when reading JSON from file and when parsing JSON with
from_json
in spark-rapids-jni.Describe alternatives you've considered
None
Additional context
The text was updated successfully, but these errors were encountered: