adding --netcdf4 option to ESMF_Regrid (option already available using CLT ESMF_RegridWeightGen)

[jvmcgovern]

Hi there,

I recently identified an issue where when I was interpolating to a large output netcdf, the .log file would indicate that I never got the line "Finalizing ESMF".

Is it possible to add netcdf4 capability to the ESMF_Regrid CLT options as with ESMF_RegridWeightGen?

Best regards

[anntsay]

it seems that the code touch many places,

[billsacks]

it seems that the code touch many places,

Finishing that comment: we felt last week that this would be too large of a change to make it into the upcoming 8.8 release. But we plan to at least get it into 8.9.

Thank you for reporting this, @jvmcgovern .

[billsacks]

@jvmcgovern I have been looking into this today. I do not have experience using ESMF_Regrid myself, so I may be missing something here, but I think that the different behavior of ESMF_Regrid means that this argument is unnecessary. Specifically: It looks like the typical operation of ESMF_Regrid is to provide an existing destination grid file, and then ESMF_Regrid adds a variable to this existing file. (This is in contrast with ESMF_RegridWeightGen, where a new file is created.) Does that sound right to you in your use case?

If so, I think the solution is to change the file type of the destination file before running ESMF_Regrid. This can be done, for example, with the NetCDF Operators (NCO) tool nccopy:

nccopy -k nc4 original.nc new.nc

Please let us know if this will resolve your issue.

[billsacks]

I'm going to close this as a wontfix based on the comment above, but @jvmcgovern feel free to comment and reopen if you feel this hasn't resolved your issue.

[jvmcgovern]

@jvmcgovern I have been looking into this today. I do not have experience using ESMF_Regrid myself, so I may be missing something here, but I think that the different behavior of ESMF_Regrid means that this argument is unnecessary. Specifically: It looks like the typical operation of ESMF_Regrid is to provide an existing destination grid file, and then ESMF_Regrid adds a variable to this existing file. (This is in contrast with ESMF_RegridWeightGen, where a new file is created.) Does that sound right to you in your use case?

If so, I think the solution is to change the file type of the destination file before running ESMF_Regrid. This can be done, for example, with the NetCDF Operators (NCO) tool nccopy:

nccopy -k nc4 original.nc new.nc

Please let us know if this will resolve your issue.

Hi @billsacks , this is an interesting work-around which I hadn't thought of. I won't have time to trial this as a solution until the new year. If it works, then it would be great to have the recommendation added to the ESMF documentation.

Season's greetings,
Joe

[billsacks]

Thanks for the reply @jvmcgovern . Yes, it would be great to have your confirmation that this solves your problem whenever you get a chance to test it. Once you do, I agree that we should document this, and I'm happy to do so.

[jvmcgovern]

[like] Joe McGovern reacted to your message:

…

________________________________ From: Bill Sacks ***@***.***> Sent: Thursday, December 19, 2024 10:57:30 PM To: esmf-org/esmf ***@***.***> Cc: Joe McGovern ***@***.***>; Mention ***@***.***> Subject: Re: [esmf-org/esmf] adding --netcdf4 option to ESMF_Regrid (option already available using CLT ESMF_RegridWeightGen) (Issue #264) Thanks for the reply @jvmcgovern<https://github.com/jvmcgovern> . Yes, it would be great to have your confirmation that this solves your problem whenever you get a chance to test it. Once you do, I agree that we should document this, and I'm happy to do so. — Reply to this email directly, view it on GitHub<#264 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AJITX7L4STN5VIDCI2QNJ7D2GNFNVAVCNFSM6AAAAABLINHG3KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNJVHEYTMNRWGY>. You are receiving this because you were mentioned.Message ID: ***@***.***> Marine Institute The information contained in this email and in any attachments is confidential and is designated solely for the attention and use of the intended recipient(s). This information may be subject to legal and professional privilege. If you are not an intended recipient of this email, you must not use, disclose, copy, distribute or retain this message or any part of it. If you have received this email in error, please notify the sender immediately and delete all copies of this email from your computer system(s). Our Privacy Policy. <https://www.marine.ie/site-area/online-policies/privacy> Foras na Mara Tá an t-eolas sa ríomhphost seo, agus in aon cheangaltáin leis, faoi rún agus tá sé dírithe ar an bhfaighteoir/na faighteoirí beartaithe amháin agus níor cheart ach dóibh siúd é a úsáid. D’fhéadfadh an t-eolas seo a bheith faoi réir pribhléid dhlíthiúil agus ghairmiúil. Mura tusa faighteoir beartaithe an ríomhphoist seo, níor cheart duit an teachtaireacht seo, nó aon chuid di, a úsáid, a nochtadh, a chóipeáil, a dháileadh nó a choinneáil. Má fuair tú an ríomhphost seo go hearráideach, cuir an seoltóir ar an eolas láithreach agus scrios gach cóip den ríomhphost seo ó chóra(i)s do ríomhaire, le do thoil. Ár bPolasaí Príobháideachta. <https://www.marine.ie/site-area/online-policies/privacy>