Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Speed up main GitHub CI
What does this add?
This PR speeds up the time for the github CI tests to pass by ~2.5x through a few basic optimizations:
Adjustments to the Makefile
Four new test conditionals were added to the
Makefile
based on groupings of how each example test needs to be ran, and how their topics relate to each other:test_example_differences
: The quick method that checks if the .py files are missing any parts in the examples/ dirtest_checkpoint_step
: tests relating to checkpoint by step and load checkpoint by steptest_checkpoint_epoch
: tests relating to checkpoint by epoch and loading checkpoint by epochtest_rest
: Everything that did not fall under the previous threeUse setup-python@v3 and cache@v3
By using these two specific actions, we can speed up the time it takes to setup the python environment, cache the pip installation, and also cache the model downloads.
Total Speedup
(This also counts as the overall time taken)
Without the cache, it's ~8.5 minutes on that first commit/run.