Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reducing the sending time for forecast tasks to write tasks #78

Closed
junwang-noaa opened this issue Mar 10, 2020 · 1 comment
Closed

reducing the sending time for forecast tasks to write tasks #78

junwang-noaa opened this issue Mar 10, 2020 · 1 comment

Comments

@junwang-noaa
Copy link
Collaborator

George/Jim found that the sending time from forecast tasks to write tasks can reach to 4.5 s for each data transfer in the high resolution global and regional run. Gerhard was working on the ESMF snapshot 8.0.1 to fix the problem, the improvement includes:

  1. write all messages from sending PEs going to the same dst PET into a single buffer and then send the whole message using single MPI_Isend
  2. optimization with option to drop the buffer for esmf for memory relief,
  3. optimization of memory copies on the send side
    also when using large value of the srcTermProcessing argument can reduce data volume and further reduce time, but for global fv3 Gaussisan grid, we will still keep srcTermProcessing=0. for regional FV3, a different value can be used. srcTermProcessing will be added in model_configure with default value 0, and fv3_cap will be updated with the ESMF_VMEpochStart future.

The feature shows the time of sending data is reduced from 4.5s to 0.5s.

@junwang-noaa
Copy link
Collaborator Author

junwang-noaa commented Nov 13, 2020

Gerhard provided a solution, and the code changes was committed with PR #160

SamuelTrahanNOAA referenced this issue in SamuelTrahanNOAA/fv3atm Apr 5, 2021
…-pgr-like-wrf

per-timestep diagnostic output: FV3 version of WRF noise parameter
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant