plot new CRPS_EMP_FAIR stat

[TatianaBurek]

Describe the Enhancement

MET development version 11.0.0-beta3 made several changes to the "stat" output.

• Issue Add the fair CRPS statistic to the ECNT line type in a new CRPS_EMP_FAIR column MET#2206 adds a new CRPS_EMP_FAIR column to the end of the ECNT line type.

Include CRPS_EMP_FAIR to plotting as a simple stat and agg stat
issues:
dtcenter/METdataio#119
dtcenter/METcalcpy#215

Time Estimate

Estimate the amount of work required here.
Issues should represent approximately 1 to 3 days of work.

Sub-Issues

Consider breaking the enhancement down into sub-issues.

• Add a checkbox for each sub-issue here.

Relevant Deadlines

List relevant project deadlines here or state NONE.

Funding Source

2799991

Define the Metadata

Assignee

• Select engineer(s) or no engineer required
• Select scientist(s) or no scientist required

Labels

• Select component(s)
• Select priority
• Select requestor(s)

Projects and Milestone

• Select Repository and/or Organization level Project(s) or add alert: NEED PROJECT ASSIGNMENT label
• Select Milestone as the next official version or Future Versions

Define Related Issue(s)

Consider the impact to the other METplus components.

• METplus, MET, METdataio, METviewer, METexpress, METcalcpy, METplotpy

Enhancement Checklist

See the METplus Workflow for details.

• Complete the issue definition above, including the Time Estimate and Funding Source.
• Fork this repository or create a branch of develop.
  Branch name: feature_<Issue Number>_<Description>
• Complete the development and test your changes.
• Add/update log messages for easier debugging.
• Add/update unit tests.
• Add/update documentation.
• Push local changes to GitHub.
• Submit a pull request to merge into develop.
  Pull request: feature <Issue Number> <Description>
• Define the pull request metadata, as permissions allow.
  Select: Reviewer(s) and Linked issues
  Select: Repository level development cycle Project for the next official release
  Select: Milestone as the next official version
• Iterate until the reviewer(s) accept and merge your changes.
• Delete your fork or branch.
• Close this issue.

[TatianaBurek]

@JohnHalleyGotway Can this statistic be calculated using agg logic? If yes, what is the formula?

[JohnHalleyGotway]

@TatianaBurek, as seen on this line of code, just like CRPS_EMP, the CRPS_EMP_FAIR statistics is aggregated as a weighted mean, where the weight is defined by the number of matched pairs listed in the TOTAL column.

[TatianaBurek]

@JohnHalleyGotway @venitahagerty I am confused. Which statistics do we need
crps_emp_fair or crpss_emp_fair?
crpss_emp_fair was added to the ECNT table:
https://github.com/dtcenter/METdataio/blob/3d1071619532be5daee3b503bb93af2fe55b4429/METdbLoad/sql/mv_mysql.sql#L452

[JohnHalleyGotway]

@TatianaBurek, yes, I see why you'd be confused. I think @venitahagerty accidentally added an extra 'S' in the statistic that she added to the database. The new statistics is named CRPS_EMP_FAIR with only one 'S'.

For reference, here are the related issues:

• Add the fair CRPS statistic to the ECNT line type in a new CRPS_EMP_FAIR column MET#2206 added CRPS_EMP_FAIR to the ECNT line type.
• Update the database schema to handle new columns and line types added to the MET-11.0.0-beta3 output.  METdataio#119 updated the database for this new statistics, but the PR Update the database schema to handle new columns and line types added to the MET-11.0.0-beta3 output. issue #119 METdataio#126 added the wrong name, CRPSS_EMP_FAIR instead of CRPS_EMP_FAIR.

And I do see a copy/paste error in the description in the MET User's Guide that likely caused the confusion. The ECNT Table describes it as:

The Continuous Ranked Probability Skill Score (empirical distribution) adjusted by subtracting 1/2(m) times the mean absolute difference of the ensemble members (m is the ensemble size)

I'll remove the word Skill from that description.

So @venitahagerty can you please update METdataio to correctly store this statistic as CRPS_EMP_FAIR?

[venitahagerty]

Sorry about that. Just fixed it in the schema in the develop branch in METdataio.

…

On Wed, Nov 2, 2022 at 8:18 AM johnhg ***@***.***> wrote: @TatianaBurek <https://github.com/TatianaBurek>, yes, I see why you'd be confused. I think @venitahagerty <https://github.com/venitahagerty> accidentally added an extra 'S' in the statistic that she added to the database. The new statistics is named CRPS_EMP_FAIR with only one 'S'. For reference, here are the related issues: - dtcenter/MET#2206 <dtcenter/MET#2206> added CRPS_EMP_FAIR to the ECNT line type <https://met.readthedocs.io/en/develop/Users_Guide/ensemble-stat.html#id2> . - dtcenter/METdataio#119 <dtcenter/METdataio#119> updated the database for this new statistics, but the PR dtcenter/METdataio#126 <dtcenter/METdataio#126> added the wrong name. And I do see a copy/paste error in the description in the MET User's Guide, that likely caused the confusion. The ECNT Table <https://met.readthedocs.io/en/develop/Users_Guide/ensemble-stat.html#id2> describes it as: The Continuous Ranked Probability Skill Score (empirical distribution) adjusted by subtracting 1/2(m) times the mean absolute difference of the ensemble members (m is the ensemble size) I'll remove the word *Skill* from that description. So @venitahagerty <https://github.com/venitahagerty> can you please update METdataio to correctly store this statistic as CRPS_EMP_FAIR? — Reply to this email directly, view it on GitHub <#421 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJGI4XQMPAJJWEKJXZUBCKDWGJZ2BANCNFSM6AAAAAAQ6WKH7U> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Venita Hagerty, PhD Research Associate CIRA at NOAA, GSL/AVID Voicemail: 307-217-6697

[TatianaBurek]

@venitahagerty I don't see this change in develop... Did you do "push"

[venitahagerty]

Change is now in develop branch

…

On Wed, Nov 2, 2022 at 8:42 AM Tatiana Burek ***@***.***> wrote: @venitahagerty <https://github.com/venitahagerty> I don't see this change in develop... Did you do "push" — Reply to this email directly, view it on GitHub <#421 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJGI4XS2MZFPE5WZ7HDJA4DWGJ4WJANCNFSM6AAAAAAQ6WKH7U> . You are receiving this because you were mentioned.Message ID: ***@***.***>

-- Venita Hagerty, PhD Research Associate CIRA at NOAA, GSL/AVID Voicemail: 307-217-6697