Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jobs in the middle of the graph can become leaves (wr scheduler only) #694

Open
mgcam opened this issue Sep 8, 2021 · 1 comment
Open
Labels

Comments

@mgcam
Copy link
Member

mgcam commented Sep 8, 2021

Example: run which got to qc complete even though there was a buried job 40759-archive_to_irods_ml_warehouse[2#888]. The job failed at 15:32:26 and the most recent status file is-rw-rw-r-- 1 gspipe gsanalysis 132 Sep 8 15:41 qc-complete.json

This was noted only for Heron runs. The pp data to iRODS are done for a subset of entities. So the PhiX job does not have a dependent job.

In general: passing through Nth element from previous node to next node when Nth doesn't exist in current node

@mgcam mgcam added the bug label Sep 8, 2021
@mgcam
Copy link
Member Author

mgcam commented Sep 8, 2021

Immediate mitigation: move pp irods archival in parallel graph path to other irods jobs

@mgcam mgcam changed the title jobs in the middle of the graph can be leaves (wr scheduler only) Jobs in the middle of the graph can become leaves (wr scheduler only) Sep 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant