Cache nodes only when ran through full pipeline

[timonv]

Is your feature request related to a problem? Please describe.
Nodes are currently cached when they pass through the caching step. This leads to problems if nodes fail further down the line.

Describe the solution you'd like
Nodes should be cached if only if they successfully pass through the pipeline. I can imagine the solution would be similar to how storage setup is currently run.

Important is that this should not break using multiple caches and work with splitting and merging.