Skip to content

Commit

Permalink
Update doc to indicate ORC and Parquet zstd read support [skip ci] (#…
Browse files Browse the repository at this point in the history
…6589)

* Update doc to indicate ORC and Parquet zstd write support

Signed-off-by: Sameer Raheja <[email protected]>

* Remove mention of zstd write

Signed-off-by: Sameer Raheja <[email protected]>

Signed-off-by: Sameer Raheja <[email protected]>
  • Loading branch information
sameerz authored Sep 21, 2022
1 parent 6d3f66c commit 6e59830
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions docs/compatibility.md
Original file line number Diff line number Diff line change
Expand Up @@ -366,9 +366,9 @@ similar issue exists for writing dates as described
to work for dates after the epoch as described
[here](https://github.com/NVIDIA/spark-rapids/issues/140).

The plugin supports reading `uncompressed`, `snappy` and `zlib` ORC files and writing `uncompressed`
and `snappy` ORC files. At this point, the plugin does not have the ability to fall back to the
CPU when reading an unsupported compression format, and will error out in that case.
The plugin supports reading `uncompressed`, `snappy`, `zlib` and `zstd` ORC files and writing
`uncompressed` and `snappy` ORC files. At this point, the plugin does not have the ability to fall
back to the CPU when reading an unsupported compression format, and will error out in that case.

### Push Down Aggregates for ORC

Expand Down Expand Up @@ -437,7 +437,7 @@ issue, turn off the ParquetWriter acceleration for timestamp columns by either s
set `spark.sql.parquet.outputTimestampType` to `TIMESTAMP_MICROS` or `TIMESTAMP_MILLIS` to by
-pass the issue entirely.

The plugin supports reading `uncompressed`, `snappy` and `gzip` Parquet files and writing
The plugin supports reading `uncompressed`, `snappy`, `gzip` and `zstd` Parquet files and writing
`uncompressed` and `snappy` Parquet files. At this point, the plugin does not have the ability to
fall back to the CPU when reading an unsupported compression format, and will error out in that
case.
Expand Down

0 comments on commit 6e59830

Please sign in to comment.