Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Flink] Add option to use JobManager to store history of jobs #151

Merged
merged 17 commits into from
Nov 28, 2023

Conversation

ranchodeluxe
Copy link
Collaborator

Mount EFS to Job Managers so they can archive jobs for historical status lookups

Addresses #122

Related PR: pangeo-forge/pangeo-forge-cloud-federation#6

@ranchodeluxe ranchodeluxe added the test-flink Add this label to PRs to trigger Dataflow integration test. label Nov 25, 2023
Copy link

codecov bot commented Nov 25, 2023

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (95ce6f4) 96.36% compared to head (20b3b31) 96.44%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #151      +/-   ##
==========================================
+ Coverage   96.36%   96.44%   +0.07%     
==========================================
  Files          15       15              
  Lines         495      506      +11     
==========================================
+ Hits          477      488      +11     
  Misses         18       18              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Collaborator

@yuvipanda yuvipanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor style changes but otherwise lgtm

pangeo_forge_runner/bakery/flink.py Outdated Show resolved Hide resolved
pangeo_forge_runner/bakery/flink.py Outdated Show resolved Hide resolved
pangeo_forge_runner/bakery/flink.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@yuvipanda yuvipanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes look good to me. One minor suggestion, will merge after that.

Thanks for incorporating this, @ranchodeluxe!

pangeo_forge_runner/bakery/flink.py Outdated Show resolved Hide resolved
@yuvipanda yuvipanda changed the title Save Job History on Flink [Flink] Add option to use JobManager to store history of jobs Nov 28, 2023
@yuvipanda yuvipanda merged commit 0401cb0 into main Nov 28, 2023
24 checks passed
@yuvipanda
Copy link
Collaborator

Thanks @ranchodeluxe!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
test-flink Add this label to PRs to trigger Dataflow integration test.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants