GMD paper model output

[navidcy]

Can we include the datasets published here in the cosima database?
https://geonetwork.nci.org.au/geonetwork/srv/eng/catalog.search#/metadata/f1296_4979_4319_7298

Or does the fact that they now live in cj50 makes it cumbersome?

[aidanheerdegen]

ping @aekiss @AndyHoggANU

[aekiss]

I was wondering the same thing. We will hopefully soon have the 3d daily data from the latest 0.1 deg IAF spinup stored on cj50 but it would be great if it could be accessed via the cookbook.

[aidanheerdegen]

It certainly can be, but we're waiting for the data there to be reorganised before setting up indexing.

[AndyHoggANU]

OK. In the meantime, can we index:

access-om2/1deg_jra55v13_iaf_spinup1_B1
access-om2-025/025deg_jra55v13_iaf_gmredi6
access-om2-01/01deg_jra55v13_iaf

all from `/g/data/hh5/tmp/cosima/'?

[aidanheerdegen]

Ok. Ran that, which threw up some issues with regional outputs:

Indexing experiment: 01deg_jra55v13_iaf
 21%|______________                                                  | 570/2700 [02:10<05:23,  6.59it/s]
ERROR:root:Error indexing /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output019/ocean/rregio
nocean_daily.nc: /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output019/ocean/rregionocean_da
ily.nc has a valid unlimited dimension, but no data
 29%|___________________                                             | 785/2700 [02:58<05:26,  5.87it/s]
ERROR:root:Error indexing /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output017/ocean/rregio
nocean_daily_3d.nc: /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output017/ocean/rregionocean
_daily_3d.nc has a valid unlimited dimension, but no data                                              
 61%|_______________________________________                        | 1655/2700 [05:34<02:42,  6.42it/s]
ERROR:root:Error indexing /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output020/ocean/rregio
nocean_daily.nc: /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output020/ocean/rregionocean_da
ily.nc has a valid unlimited dimension, but no data
 69%|____________________________________________                   | 1862/2700 [06:13<01:15, 11.06it/s]
ERROR:root:Error indexing /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output017/ocean/rregio
nocean_daily.nc: /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output017/ocean/rregionocean_da
ily.nc has a valid unlimited dimension, but no data
 93%|___________________________________________________________    | 2510/2700 [07:39<00:18, 10.09it/s]
ERROR:root:Error indexing /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output018/ocean/rregio
nocean_daily.nc: /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf/output018/ocean/rregionocean_da
ily.nc has a valid unlimited dimension, but no data
100%|_______________________________________________________________| 2700/2700 [08:04<00:00,  5.57it/s]

I have checked and the experiments are now in the database, but there are no metadata.yaml files for any of these experiments. When they are added I'd suggest adding a keyword for them all to indicate they are related to that paper. Perhaps gmd-2020.

/g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf could do with a clean up.

[aidanheerdegen]

Still not metadata in those three directories @AndyHoggANU @aekiss

[aidanheerdegen]

Still no metadata @AndyHoggANU @aekiss (and /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf still needs cleaning up: multiple PBS log files in top level)

[aidanheerdegen]

ping @AndyHoggANU @aekiss

Still no metadata and directories need cleaning up.

[aekiss]

oops, sorry, I'll sort it out

[aidanheerdegen]

Check #4 to see if it needs sorted. I admit I am confused about what is what.

[aidanheerdegen]

Cleaning up old issues, and it seems /g/data/hh5/tmp/cosima/access-om2-01/01deg_jra55v13_iaf is still a bit messy @aekiss

Or is this data somewhere else now and should be indexed there?