Skip to content
This repository has been archived by the owner on Sep 27, 2023. It is now read-only.

Update AWS S3/EC2 sync operations (#1290) #1291

Merged
merged 50 commits into from
Jun 1, 2023
Merged

Conversation

Thistleman
Copy link
Contributor

@Thistleman Thistleman commented May 25, 2023

This PR will update/create the CI/CD workflow for syncing s3 and updating versions.gridlabd.us. This is a targeted CI/CD update that should be considered separately from the mass image generation and upload PR, as it deals with a much more specific issue and a significantly different potential process, which should not delay the other higher priority PR.

Current Issues

TODO

Code Changes

  • AWS S3 sync on cloud folders
    • code.gridlabd.us
    • docs.gridlabd.us
    • geodata.gridlabd.us
    • install.gridlabd.us
    • status.gridlabd.us
    • tutorials.gridlabd.us
    • www.gridlabd.us
  • Upgrade version.gridlabd.us to serverless lambda queries
    • Implement terraform to deploy lambda infrastructure
    • Implement CI/CD to update lambda app.py as needed
    • Change "version.gridlabd.us" endpoint to use api gateway endpoint in route53 and cloudfront
    • Add route to update official latest version for master and develop routes
    • Add security keys for update_latest routes
    • Add route for logging and timestamp of version calls
    • Add support for querying stats of all version calls, with system for additional grouping to be added later

Bug Fixes

None

Documentation Changes

Added README.md to version.gridlabd.us folder with instructions on using the terraform files and the lambda routes.

Test and Validation notes

(develop/master)-images.yml workflow is meant to only be used when merges are completed to their respective branches.

* placeholder to create pr

* generic workflows added, needs refinement

* added terraform to deploy versions and baseline terraform infrastructure for updating implementation

* added requirements files back to gitignore

* tweaked tf, added tf artifacts to ignore

* updated tf

* fixed region

* mostly working deployment

* removed unused template.yaml

* added checks for tables and creation if not exist

* test new run for s3 updates

* get environment plsssss

* try again? Do I need to make a local branch?

---------

Co-authored-by: Duncan Ragsdale <[email protected]>
Co-authored-by: David P. Chassin <[email protected]>
@Thistleman Thistleman changed the title Develop update versions (#1290) Update AWS S3/EC2 sync operations (#1290) May 25, 2023
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 19:57 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 19:57 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 19:57 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:16 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:16 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:16 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:16 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:16 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:31 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:31 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:31 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:31 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:31 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:50 — with GitHub Actions Inactive
@Thistleman Thistleman temporarily deployed to Integration June 1, 2023 20:57 — with GitHub Actions Inactive
@Thistleman Thistleman merged commit 457dc2c into develop Jun 1, 2023
@Thistleman Thistleman deleted the develop-update-s3 branch June 1, 2023 21:03
@aivanova5 aivanova5 mentioned this pull request Jun 1, 2023
72 tasks
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants