2022/03/15 HARP Weekly Work Session

[rburghol]

• RB last week:
  • did full basin test for Roanoke: Updated Scripts to Add Meteorology Data set model_meteorology#29
  • Did a full basin runoff export from P6, and ran in the James Land Segment WDM Runoff Export cbp_wsm#59 (comment)
  • All my work leverages the new scripts that are outlined in detail here: Updated Scripts to Add Meteorology Data set model_meteorology#29
  • And I developed a short, land segment specific workflow here: Running P5.3.2 (Southern Rivers) for new Meteorology #166
• What are F land segments? Phase 5.3.2 land segments with Prefix "F" #164
• Synthetic Meteorology datasets. See Mix and match Meteorology to project the upcoming summer #141
  • Creates alternative lseg_csvs files for import into WDM
    • Use R
    • Open a historic meteorology lseg_csv
    • manipulate it:
      • Create climate change distortions (tbd, but in general: peaks go up, et goes up, small rain may go down?)
      • Create drought mash-ups, i.e, Jan-1-2018 to 12-31-2021 + 1-1-2002 to 12-31-2002
      • Finish updated downloads and then do Jan-1-2018 through 3/1/2022 and append mashups
• Land Segs with QA needs
  • A51810 : see Chowan (Meherrin/Nottoway) in Running P5.3.2 (Southern Rivers) for new Meteorology #166
  • I think this one is in Add Missing Southern Rivers Land segments #98

 PROBLEM ERROR Hourly data outside valid range
 data=    1127.18115

• Running lseg visualization script:

Error in file(file, "rt") : cannot open the connection
In addition: Warning message:
In file(file, "rt") :
  cannot open URL 'http://deq1.bse.vt.edu:81/met/out/lseg_csv/1984010100-2020123123/A51810.HSET': HTTP status was '404 Not Found'

• Most file are there, did I miss a step in my process?

ls out/lseg_csv/1984010100-2020123123/A51810.* -lhrt
-rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.DPT
-rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.PET
-rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.PRC
-rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.RAD
-rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.TMP
-rw-rw-r--+ 1 7442902 allmodelers 6.4M Mar 22 18:02 out/lseg_csv/1984010100-2020123123/A51810.WND

[alexwlowe]

Update 3/23/2022
The data outside valid range error is shown below:

 PROBLEM ERROR Hourly data outside valid range
 data=    1127.18115

It appears to occur in Gopal's wdm_insert_ALL funciton. The line that produces the error is here. The error can also be produced six more times in the script, one for each metric (prp, pet, rad, etc.). I think this means that the function does not like the land segment data it is receiving.

[alexwlowe]

Update 3/23/2022
The .HSET error occurs because the hargreaves samani method of evapotranspiration has not been run for every land segment (ie it is not in our current functionalized workflow). I am currently working on functionalizing the creation of .HSET so that they can be incorporated in the workflow!

The two functions that I have created are located in /backup/meteorology/R

• hset_generation.R: runs generate_lseg_hset and writes output to desired directory
• generate_lseg_hset.R: creates hset csv files from precip and radiation data