Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make release Job Take Inputs From Multi-Target Deployments #200

Open
CodeGat opened this issue Dec 17, 2024 · 5 comments
Open

Make release Job Take Inputs From Multi-Target Deployments #200

CodeGat opened this issue Dec 17, 2024 · 5 comments
Assignees
Labels
priority:medium type:enhancement Improvements to existing features

Comments

@CodeGat
Copy link
Member

CodeGat commented Dec 17, 2024

We don't want a Release made from every deployment - instead, we would like to merge information from all the deployment targets when making a release.

@CodeGat CodeGat added priority:medium type:enhancement Improvements to existing features labels Dec 17, 2024
@CodeGat CodeGat self-assigned this Dec 17, 2024
@CodeGat
Copy link
Member Author

CodeGat commented Dec 23, 2024

In that case, what happens if the versions diverge?

For example, what if we needed to fix up something on one target, but not the other? Should they both be bumped, and only one of them released? Should we have a release per target? Hm.......

@CodeGat
Copy link
Member Author

CodeGat commented Jan 4, 2025

On Zulip, we discussed different options for this release pipeline, and we noted:

Option 1: Have a single model version across HPCs
This would mean that the version of a model would be shared between HPCs. For example, both Gadi and Setonix deployments would share a GitHub Release of 2025.01.0, and have the same version. But this creates problems if a model requires changes for only one HPC.

Option 2: Versions of a model can vary based on HPC
This would mean that we create GitHub Releases for a particular HPC target, rather than overall. For example, there could be a GitHub Release for Gadi at 2025.01.0, and a different GitHub Release for Setonix at 2025.01.1. This might be confusing for users to see that there are releases for different environments.

Option 3: Have a canonical HPC target and version at Gadi, and the other HPCs are just a bonus
This would mean that we do things as we do it now, having a Release artifact for Gadi, but we deploy to other HPCs as a bonus.

And am currently considering Option 1 for majors, and Option 2 for minors, potentially.

@CodeGat
Copy link
Member Author

CodeGat commented Jan 6, 2025

After a conversation with @aidanheerdegen - we note that we will just go with Option 1. In the case where one deployment target needs a fix that the other one doesn't, the other will essentially have the same contents as the minor version.

@CodeGat
Copy link
Member Author

CodeGat commented Jan 7, 2025

Old Release Notes (minus autogenerated section)

This release of access-om2 2024.03.0 uses spack-packages 2024.03.22 and spack-config 2024.03.22.

@CodeGat
Copy link
Member Author

CodeGat commented Jan 7, 2025

New Release Notes (minus autogenerated section)

This is an official release of access-om2 2024.03.0.

Deployment Information

Gadi

Deployed using spack 0.22, spack-packages 2024.03.22 and spack-config 2024.03.22.
Deployed as module accessible using:

module use /g/data/vk83/modules
module load access-om2/2024.03.0

Setonix

Deployed using spack 0.22, spack-packages 2024.03.22 and spack-config 2024.03.22.
Deployed as module accessible using:

module use /some/other/modules
module load access-om2/2024.03.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
priority:medium type:enhancement Improvements to existing features
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant