Lossy compression #464
Merged
Lossy compression #464
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Greg Sjaardema <[email protected]>
* IOSS: Catalyst API 2 Added support to database for using my_processor and processor_count IOSS properties when operating in serial parallel mode and reading Conduit files. * IOSS: Catalyst API 2 Changed Conduit serial parallel test to use files from the one MPI rank can.ex2 test. --------- Co-authored-by: Greg Sjaardema <[email protected]>
Create the cell_ids and cell_node_ids fields for a StructuredBlock when asked for by a reading application, if these fields are not already stored in the Conduit data. Uses the get_cell_ids() and get_cell_node_ids() methods on StructuredBlock.
* IOSS: Catalyst API 2 Added support to database for using my_processor and processor_count IOSS properties when operating in serial parallel mode and reading Conduit files. * IOSS: Catalyst API 2 Changed Conduit serial parallel test to use files from the one MPI rank can.ex2 test. --------- Co-authored-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
Signed-off-by: Greg Sjaardema <[email protected]>
tokusanya
pushed a commit
to tokusanya/seacas
that referenced
this pull request
Sep 11, 2024
* EXODUS: Add support for lossy compression via netCDF quantize method * IOSS: Add support for lossy compression specifying NSD for netCDF quantize method * EXODUS: Update version date * EXODUS: Add some error checking on nsd values * EXODUS: Check if Quantization supported; include in config output * EXODUS: Cleaning up new compression support * EXODUS: Fix error handling code * EXODUS: Better error checking on compression * IOSS: Support for zstd compression * IOSS: Handle building with no netCDF-4 capability * IOSS: Change gold files to netcdf-3 so work without hdf5-supported netCDF * CI: See if can figure out intel build failure * CI: Fix hdf5 version warning message * CI: Turn on plugins; support new syntax * EXODUS: Only flush stderr if written to Signed-off-by: Greg Sjaardema <[email protected]> * Tweak compression additions * CI: Fix intel build script syntax error * EXODUS: Support new netCDF with changed _FillValue * IOSS: Fix so latest fmt version works * IOSS: Catalyst API 2 (sandialabs#463) * IOSS: Catalyst API 2 Added support to database for using my_processor and processor_count IOSS properties when operating in serial parallel mode and reading Conduit files. * IOSS: Catalyst API 2 Changed Conduit serial parallel test to use files from the one MPI rank can.ex2 test. --------- Co-authored-by: Greg Sjaardema <[email protected]> * Fix export symbols (sandialabs#465) * IOSS: Catalyst API 2 (sandialabs#466) Create the cell_ids and cell_node_ids fields for a StructuredBlock when asked for by a reading application, if these fields are not already stored in the Conduit data. Uses the get_cell_ids() and get_cell_node_ids() methods on StructuredBlock. * CI: Remove hdf5-1.8 testing * IOSS: Catalyst API 2 (sandialabs#463) * IOSS: Catalyst API 2 Added support to database for using my_processor and processor_count IOSS properties when operating in serial parallel mode and reading Conduit files. * IOSS: Catalyst API 2 Changed Conduit serial parallel test to use files from the one MPI rank can.ex2 test. --------- Co-authored-by: Greg Sjaardema <[email protected]> * NEM_SPREAD: Add missing include file * CI: Enable netCDF quantize option * CI: Support newest netCDF; fmt * Enable new compression options * EXODUS: Fix non-hdf5 build * EXODUS: Do not commit the kluge to repository * IOSS: See if can fix spack ci build * CI: Spack build should not run on PR * CI: Spack build on master only [ci skip] * CI: Fix spack workflow syntax [ci skip] * IOSS: Add progress output to chain/face generation * IOSS: Reduce Face memory * EXODUS: Better control over exodus verbosity * EXODUS:, IOSS: Add bzip2 compression support * Further testing of non-lossy compression with plugins * CI: Update cmake-sems to work with current sems * Default netcdf should be 4.9.2 Signed-off-by: Greg Sjaardema <[email protected]> * Clean up copyright dates Signed-off-by: Greg Sjaardema <[email protected]> * Clean up copyright dates Signed-off-by: Greg Sjaardema <[email protected]> * accidentally added to pr; removed Signed-off-by: Greg Sjaardema <[email protected]> --------- Signed-off-by: Greg Sjaardema <[email protected]> Signed-off-by: Greg Sjaardema <[email protected]> Co-authored-by: Greg Sjaardema <[email protected]> Co-authored-by: tjotaha <[email protected]> Co-authored-by: Spiros Tsalikis <[email protected]>
mvlopri
pushed a commit
to mvlopri/seacas
that referenced
this pull request
Sep 26, 2024
* EXODUS: Add support for lossy compression via netCDF quantize method * IOSS: Add support for lossy compression specifying NSD for netCDF quantize method * EXODUS: Update version date * EXODUS: Add some error checking on nsd values * EXODUS: Check if Quantization supported; include in config output * EXODUS: Cleaning up new compression support * EXODUS: Fix error handling code * EXODUS: Better error checking on compression * IOSS: Support for zstd compression * IOSS: Handle building with no netCDF-4 capability * IOSS: Change gold files to netcdf-3 so work without hdf5-supported netCDF * CI: See if can figure out intel build failure * CI: Fix hdf5 version warning message * CI: Turn on plugins; support new syntax * EXODUS: Only flush stderr if written to Signed-off-by: Greg Sjaardema <[email protected]> * Tweak compression additions * CI: Fix intel build script syntax error * EXODUS: Support new netCDF with changed _FillValue * IOSS: Fix so latest fmt version works * IOSS: Catalyst API 2 (sandialabs#463) * IOSS: Catalyst API 2 Added support to database for using my_processor and processor_count IOSS properties when operating in serial parallel mode and reading Conduit files. * IOSS: Catalyst API 2 Changed Conduit serial parallel test to use files from the one MPI rank can.ex2 test. --------- Co-authored-by: Greg Sjaardema <[email protected]> * Fix export symbols (sandialabs#465) * IOSS: Catalyst API 2 (sandialabs#466) Create the cell_ids and cell_node_ids fields for a StructuredBlock when asked for by a reading application, if these fields are not already stored in the Conduit data. Uses the get_cell_ids() and get_cell_node_ids() methods on StructuredBlock. * CI: Remove hdf5-1.8 testing * IOSS: Catalyst API 2 (sandialabs#463) * IOSS: Catalyst API 2 Added support to database for using my_processor and processor_count IOSS properties when operating in serial parallel mode and reading Conduit files. * IOSS: Catalyst API 2 Changed Conduit serial parallel test to use files from the one MPI rank can.ex2 test. --------- Co-authored-by: Greg Sjaardema <[email protected]> * NEM_SPREAD: Add missing include file * CI: Enable netCDF quantize option * CI: Support newest netCDF; fmt * Enable new compression options * EXODUS: Fix non-hdf5 build * EXODUS: Do not commit the kluge to repository * IOSS: See if can fix spack ci build * CI: Spack build should not run on PR * CI: Spack build on master only [ci skip] * CI: Fix spack workflow syntax [ci skip] * IOSS: Add progress output to chain/face generation * IOSS: Reduce Face memory * EXODUS: Better control over exodus verbosity * EXODUS:, IOSS: Add bzip2 compression support * Further testing of non-lossy compression with plugins * CI: Update cmake-sems to work with current sems * Default netcdf should be 4.9.2 Signed-off-by: Greg Sjaardema <[email protected]> * Clean up copyright dates Signed-off-by: Greg Sjaardema <[email protected]> * Clean up copyright dates Signed-off-by: Greg Sjaardema <[email protected]> * accidentally added to pr; removed Signed-off-by: Greg Sjaardema <[email protected]> --------- Signed-off-by: Greg Sjaardema <[email protected]> Signed-off-by: Greg Sjaardema <[email protected]> Co-authored-by: Greg Sjaardema <[email protected]> Co-authored-by: tjotaha <[email protected]> Co-authored-by: Spiros Tsalikis <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implement a lossy compression option in Exodus / Ioss / Applications using the quantize method from netCDF.