Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Demonstrate Data Preparation for NextGen-based modeling for developers workshop #40

Open
jameshalgren opened this issue Mar 7, 2023 · 2 comments

Comments

@jameshalgren
Copy link
Contributor

jameshalgren commented Mar 7, 2023

Summary

For the CIROH Training and Developers Conference, we need to demonstrate how to access basic sources of input data to prepare a data package to go with the NextGen-In-A-Box resource.

What we need to cover in the workshop:

The workshop would ideally cover everything needed to run a basic CFE-based simulation in the NextGen framework. The minimum input set for that is the following:

  • Forcing Datasets
  • Hydrofabric dataset (catchment.geojson, nexus.geojson)
  • Partition File (for parallel execution of NextGen framework models; also derived from hydrofabric Geopackage)
  • Realization File
  • Warm State/.ini files

We do not expect that the Warm State capability will be available by the time we do the workshop, so we will probably use a static .ini file. We are also planning on a stock realization file that would only need to be updated with the file paths for a custom implementation.

So, in general, we need to create two main notebooks with a demonstration of :

  1. How to download and process the static hydrofabric data to prepare the catchment and nexus files.
  2. How to download and process the dynamic forcing data

We can share stock examples of the realization file, partition file, and .ini file.

We would eventually need a notebook showing how to work through the process of

  1. How to create a warmstate file.

pinging @igarousi @Castronova

Notes

Sources of Data

AORC – Forcing resource
AORC version 1.0 – corresponds (we think) to the NWM 2.0 and 2.1 datasets

https://nwm-archive.s3.amazonaws.com/index.html
NWM 1.2 - Forced with NLDAS

https://noaa-nwm-retro-v2-0-pds.s3.amazonaws.com/index.html
NWM 2.0 - Forced with AORC 1.0

https://noaa-nwm-retrospective-2-1-pds.s3.amazonaws.com/index.html
NWM 2.1 - Forced with AORC 1.0

AORC 1.1 – not yet used for NWM retrospective

Hydrofabric

Capability to identify upstream watershed from a Lat-lon (use this for the actual subset)

Forcing Datasets

https://github.com/jameshalgren/data-access-examples/blob/DONOTMERGE_VPU16/ngen_forcing/VERYROUGH_RTI_Forcing_example.ipynb

@Castronova
Copy link

@jameshalgren jameshalgren changed the title Create notebooks for developers workshop Create notebooks to demonstrate Data Preparation for NextGen-based modeling for developers workshop Apr 18, 2023
@jameshalgren jameshalgren changed the title Create notebooks to demonstrate Data Preparation for NextGen-based modeling for developers workshop Demonstrate Data Preparation for NextGen-based modeling for developers workshop Apr 18, 2023
@jameshalgren
Copy link
Contributor Author

@morshedniaz
We need to add the contributing instructions (which will be the workshop handout) here:
https://github.com/AlabamaWaterInstitute/data_access_examples/tree/main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants