Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(test, release): nightly snapshot release and upgrade testing #1141

Merged
merged 28 commits into from
Sep 27, 2024

Conversation

justinthelaw
Copy link
Contributor

@justinthelaw justinthelaw commented Sep 25, 2024

Description

As part of compliance with the Made for UDS requirements, upgrade testing must be implemented separately from E2E functional/performance tests. Upgrade tests consist of an installation of a previous bundle version, performing a deployment of the newer "snapshot" bundle, and then running all E2E tests against the upgraded bundle.

This PR also implements a snapshot release, allowing for the separation of the creation of a dev bundle from the testing workflow. This allows for graceful handling of build errors (stop early, re-run) and aligns us with OSS/best practice standards for producing frequent releases for testing. As part of this implementation, releases are now a modular action that accepts two inputs, release tag and sub-repo.

NOTE: the nightly takes about 3 hours to complete - that's 3 hours of large runner costs

BREAKING CHANGES

  • N/A

CHANGES

  • adds an upgrade test that runs nightly against the last tagged release and the current commit on main
  • adds a snapshot release workflow that runs nightly using the current commit on main
  • refactors release to be a modular action used by release and nightly-snapshot-release

Related Issue

Relates to #702

Checklist before merging

@justinthelaw justinthelaw self-assigned this Sep 25, 2024
@justinthelaw justinthelaw requested a review from a team as a code owner September 25, 2024 14:51
@justinthelaw justinthelaw linked an issue Sep 25, 2024 that may be closed by this pull request
@justinthelaw justinthelaw marked this pull request as draft September 25, 2024 14:51
Copy link

netlify bot commented Sep 25, 2024

Deploy Preview for leapfrogai-docs canceled.

Name Link
🔨 Latest commit 102a051
🔍 Latest deploy log https://app.netlify.com/sites/leapfrogai-docs/deploys/66f4bcc4f70602000846e5e4

@justinthelaw justinthelaw marked this pull request as ready for review September 25, 2024 15:50
@justinthelaw justinthelaw changed the title chore(test): nightly upgrade testing chore(test): nightly bundle upgrade testing Sep 25, 2024
@justinthelaw justinthelaw linked an issue Sep 25, 2024 that may be closed by this pull request
@justinthelaw justinthelaw changed the title chore(test): nightly bundle upgrade testing chore(test, release): nightly bundle snapshot release and upgrade testing Sep 25, 2024
@justinthelaw justinthelaw changed the title chore(test, release): nightly bundle snapshot release and upgrade testing chore(test, release): nightly snapshot release and upgrade testing Sep 25, 2024
@justinthelaw justinthelaw merged commit b43c30c into main Sep 27, 2024
29 checks passed
@justinthelaw justinthelaw deleted the 702-choretest-bundle-and-package-upgrade-testing branch September 27, 2024 20:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

chore: create a snapshot release workflow chore(test): bundle and package upgrade testing
3 participants