Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update VIIRS AOD converter to work with NASA Dark Target and Deep Blue products #1604

Merged
merged 13 commits into from
Feb 19, 2025

Conversation

weiwilliam
Copy link
Contributor

Description

This PR makes follow updates:

  1. Use the original NOAA data reading code as a function.
  2. Add two functions for NASA Dark Target and Deep Blue products.
  3. Remove the argument to mask out _FillValue data, always keeps valid points now.
  4. Update the dateTime to seconds from epoch time.
  5. Add an optional argument of date_range to process data within the specified window.
  6. Updated list of arguments:
    Required: --input, --output, --provider [nasa/noaa]
    Optional: --retrieval_method [DarkTarget/DeepBlue], --error_method [pue], -n (--thin), --date_range

Observation error selection:
Pixel-level uncertainties estimates (PUE) are recommended for DA purposes based on section 3.1 VIIRS DeepBlue paper.

For NOAA product, the PUE is surface-dependent error statistics with considering solar zenith angle and sensor viewing angle, so I modified the original "nesdis" method to "pue".

For NASA Dark Target, I could not find papers about the PUE, so the expected error (EE) is assigned as default.

For NASA Deep Blue, the PUE are two variables for the retrieval over land or ocean.
I currently assign the PUE to obs error based on the number of land and ocean points used in retrieval.
In the case of data retrieved with land and ocean points together,

  • The number of land points is more, use the PUE over land and vice versa.
  • By any chance the numbers of land and ocean points are equal, use the average of PUE.
    Additionally, for Deep Blue retrieved with land and ocean points, the PreQC value uses the poorer quality when the numbers of land and ocean points are equal.

Issue(s) addressed

Resolves #1563

Dependencies

List the other PRs that this PR is dependent on:

  • ...

Impact

Expected impact on downstream repositories:

Checklist

  • I have performed a self-review of my own code
  • I have made corresponding changes to the documentation
  • I have run the unit tests before creating the PR

Sorry, something went wrong.

@CoryMartin-NOAA
Copy link
Contributor

Please merge in develop and then I think this can be approved

@BenjaminRuston BenjaminRuston merged commit cdab772 into develop Feb 19, 2025
2 checks passed
@BenjaminRuston BenjaminRuston deleted the feature/nasa_viirs_aod branch February 19, 2025 22:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

VIIRS NASA products converter
4 participants