Load checkpoints with eval_setup from different folder from training #3485
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Previously, if one ran
ns-train
from a directory, then any call toeval_setup
would have to be called from a directory where the relative layout of the outputs folder had to match training. I changed this to take into account the full path to the config.yml file in eval_setup so that it loads checkpoints folders not equivalent to the training folder.For example, running this will fail:
There still needs to be some work to make data path agnostic to the running dir, but this so far at least makes it agnostic for the checkpoint folder.
One option is making data paths absolute, though this would break if you try to send checkpoints+data to other people, or move the original data dir around.