Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add quartz yaml and fix scheduler startup script #118

Merged
merged 1 commit into from
Jul 10, 2024

Conversation

OlgaKogiou
Copy link
Contributor

@OlgaKogiou OlgaKogiou commented Jul 10, 2024

In this PR we add the following two things.

  1. Quartz yaml: A configuration to run the Dask distributed scripts on the Quartz cluster at Livermore Computing.
  2. Fix for error checking for the Dask scheduler. DFAnalyzer can use the Dask cluster to perform distributed analysis. In the start_dask_distributed.sh, we added a condition to check the scheduler's successful execution. The scheduler outputs a JSON file that can be checked at runtime for creation. If it is not created, we add a message to the users to check for errors.

Verified

This commit was signed with the committer’s verified signature. The key has expired.
tvdeyen Thomas von Deyen
@hariharan-devarajan hariharan-devarajan changed the title Changed start_dask_distributed.sh to check for running scheduler Check for running dask scheduler Jul 10, 2024
@hariharan-devarajan hariharan-devarajan changed the title Check for running dask scheduler Add quartz yaml and fix scheduler startup script Jul 10, 2024
Copy link
Member

@hariharan-devarajan hariharan-devarajan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes look good. Thanks for the PR.

@hariharan-devarajan hariharan-devarajan merged commit 759f8f8 into LLNL:develop Jul 10, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants