Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decrease the memory usage by MERRA2 for 6 times #903

Merged
merged 20 commits into from
Nov 18, 2021

Conversation

AnningCheng-NOAA
Copy link
Contributor

@AnningCheng-NOAA AnningCheng-NOAA commented Nov 9, 2021

PR Checklist

  • [X ] Ths PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR. Please consult the ufs-weather-model wiki if you are unsure how to do this.

  • [ X] This PR has been tested using a branch which is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR

  • [ X] An Issue describing the work contained in this PR has been created either in the subcomponent(s) or in the ufs-weather-model. The Issue should be created in the repository that is most relevant to the changes in contained in the PR. The Issue and the dependent sub-component PR
    are specified below.

  • Results for one or more of the regression tests change and the reasons for the changes are understood and explained below.

  • New or updated input data is required by this PR. If checked, please work with the code managers to update input data sets on all platforms.

Instructions: All subsequent sections of text should be filled in as appropriate.

The information provided below allows the code managers to understand the changes relevant to this PR, whether those changes are in the ufs-weather-model repository or in a subcomponent repository. Ufs-weather-model code managers will use the information provided to add any applicable labels, assign reviewers and place it in the Commit Queue. Once the PR is in the Commit Queue, it is the PR owner's responsiblity to keep the PR up-to-date with the develop branch of ufs-weather-model.

Description

Provide a detailed description of what this PR does. What bug does it fix, or what feature does it add? Is a change of answers expected from this PR? Are any library updates included in this PR (modulefiles etc.)?
read MERRA2 data for two months instead of 12 months and read in the data in interpolation when needed. The memory usage by MERRA2 decreases 6 times. There is no results change. no library update.

Issue(s) addressed

Link the issues to be closed with this PR, whether in this repository, or in another repository.
(Remember, issues must always be created before starting work on a PR branch!)

Testing

How were these changes tested? What compilers / HPCs was it tested with? Are the changes covered by regression tests? (If not, why? Do new tests need to be added?) Have regression tests and unit tests (utests) been run? On which platforms and with which compilers? (Note that unit tests can only be run on tier-1 platforms)

  • hera.intel regression tests has been successful in hera
  • hera.gnu
  • orion.intel
  • cheyenne.intel
  • cheyenne.gnu
  • gaea.intel
  • jet.intel
  • wcoss_cray
  • wcoss_dell_p3
  • opnReqTest for newly added/changed feature
  • CI

Dependencies

If testing this branch requires non-default branches in other repositories, list them. Those branches should have matching names (ideally).

@DeniseWorthen
Copy link
Collaborator

Please fill out the required information in the PR template, including the relevant PRs that you've made in FV3 or CCPP relating to this change.

@AnningCheng-NOAA
Copy link
Contributor Author

AnningCheng-NOAA commented Nov 10, 2021 via email

@DeniseWorthen
Copy link
Collaborator

Anning, it looks like this also makes a change in ccpp/physics but I don't see it listed here.

It's also really helpful to have the actual link to the issue or PR in the template. You can do that by using the 'insert link' button and then copying the url from the other repo. Or, within the same repo (for example, in FV3), you can just start typing the words "fixes #" and a list of possible issues and PRs will pop-up for you to chose from.

Also, can you edit the title of your FV3 PR? It needs to be descriptive of your change and you have "changes made in gitmodules"

@AnningCheng-NOAA
Copy link
Contributor Author

AnningCheng-NOAA commented Nov 10, 2021 via email

@DeniseWorthen
Copy link
Collaborator

On the far right side next to the title is a button that says "edit". You can change the title there.

@AnningCheng-NOAA AnningCheng-NOAA changed the title Mr2memL Decrease the memory usage by MERRA2 for 6 times Nov 10, 2021
@AnningCheng-NOAA
Copy link
Contributor Author

AnningCheng-NOAA commented Nov 10, 2021 via email

@junwang-noaa
Copy link
Collaborator

Please fix the revision of your fv3 branch.

Copy link
Collaborator

@climbfuji climbfuji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. Will approve after regression testing is complete and the submodule pointer was updated.

@junwang-noaa
Copy link
Collaborator

@climbfuji All the RT passed. Would you please commit CCPP PR#774? Thanks

@climbfuji
Copy link
Collaborator

@climbfuji All the RT passed. Would you please commit CCPP PR#774? Thanks

Done - new ccpp-physics hash is 27a312c

.gitmodules Outdated Show resolved Hide resolved
Copy link
Collaborator

@climbfuji climbfuji left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

.gitmodules needs to be reverted

@junwang-noaa junwang-noaa merged commit 805421d into ufs-community:develop Nov 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
No Baseline Change No Baseline Change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Decrease the usage of memory 6 times by reading MERRA2 data for 2 months instead of 12 months
5 participants