Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix incorrect assertion in schedule! #370

Merged
merged 2 commits into from
Feb 3, 2023
Merged

Conversation

jpsamaroo
Copy link
Member

Previously, we had an assertion in schedule! that a task being scheduled could not already have a cache result, as that seems counterintuitive. However, when an upstream task has thrown an error, downstream tasks are all eagerly tainted by set_failed!, which sets their cache value to the ThunkFailedException object.

This PR loosens that assertion to ignore errored tasks, and refines the non-erroring case to throw a SchedulingException to the task instead.

@jpsamaroo
Copy link
Member Author

Also, this improves ThunkFailedException printing, which was previously far too verbose for wide or deep DAGs.

@jpsamaroo jpsamaroo merged commit 0107b31 into master Feb 3, 2023
@jpsamaroo jpsamaroo deleted the jps/task-in-cache-bug branch February 3, 2023 19:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant