Examples for NetCDF, HDF4, HDF5, TIFF, and OPeNDAP

[mmccarty]

A few simple example catalogs for these file types that:

• Load data
• Inspect metadata
• Show a simple plot

[jhamman]

xarray also supports backends that access grib, and zarr formats. Examples may want to include those formats as well.

[martindurant]

Yes, agree on GRIB (via PyNIO) and TIFF should be there too. We may not want to include opendap here, though, since that would need a remote data source.

[martindurant]

Except I notice PyNIO still isn't released for py3.

[jhamman]

Yes, NCAR/pynio#17 is still lingering. I have been using their dev release of the python3 code and it seems to be working. I wouldn't let this slow you down though. They'll have to get it done by the end of the year because xarray is dropping py2 support then.

[martindurant]

@jhamman , is loading via pynio compatible with the chunks= parameter, i.e., using with dask?

[martindurant]

(never mind, found a GRIB, tried it, and it works just fine)

[jhamman]

What is the status of intake-xarray and open-dap served datasets?

[martindurant]

Local files (netcdf, grib, tiff, zarr...) and remote (zarr only) datasets will be totally good.

As of #11 , intake should also be able to stream any of these formats, i.e., so that you can read netcdf remotely. The server isn't meant for production, however, and doubtless isn't any kind of performant - it's really meant as POC from a big data point of view.