Improve error message in ModularPipelineError
raised within _validate_datasets_exist()
#3953
Labels
Issue: Feature Request
New feature or improvement to existing feature
Description
A nice feature of modular pipelines is that if you make a mistake in mapping inputs/outputs to what nodes need, it raises a
ModularPipelineError
with a helpful message containing a set of catalog items you missed:However I think this error message can be even more useful if we detail the mismatch more. For example, to distinguish this:
pipeline
wrapper?pipeline
wrapper that none of the nodes need?As far as I understand, those 2 scenarios would now lead to the same error message. However it seems possible to make this distinction based on inputs that go to
_validate_datasets_exist()
function that's responsible for raising this exception.Context
I think it might improve developer experience while building modular pipelines.
Possible Implementation
Instead of inferring a single list of mismatches:
Infer it as two separate sets (that sum to
non_existent
) called something likeredundant_inputs
andmissing_inputs
. And configure the error message reflect the difference.The text was updated successfully, but these errors were encountered: