Skip to content
This repository has been archived by the owner on Jun 20, 2024. It is now read-only.

Parallelise setup.sh's individual tasks. #2704

Merged
merged 2 commits into from
Jan 9, 2017
Merged

Conversation

marccarre
Copy link
Contributor

Time spent running the setup steps becomes a blocker when trying to ramp up the number of test servers, given we are currently mainly blocking on I/O -- i.e. many files are uploaded/downloaded, which could easily be done faster.
This is a pre-change refactoring for the #2647 and #2648 work.

@marccarre marccarre force-pushed the 2647-parallelise-setup branch 5 times, most recently from 3cdeb6e to 56d1140 Compare December 21, 2016 10:11
@marccarre marccarre self-assigned this Dec 21, 2016
@marccarre marccarre force-pushed the 2647-parallelise-setup branch from 56d1140 to c2bb542 Compare December 21, 2016 10:31
@marccarre marccarre requested review from brb, awh and bboreham December 21, 2016 16:44
@marccarre marccarre added this to the 1.9.0 milestone Dec 21, 2016
@marccarre marccarre removed their assignment Jan 9, 2017
@marccarre marccarre force-pushed the 2647-parallelise-setup branch from c2bb542 to e834932 Compare January 9, 2017 09:18
pull_if_missing() {
if ! exists_on "$1" "$2" ; then
echo "Pulling $2 on $1..."
docker_on $1 pull $2 >/dev/null 2>&1

This comment was marked as abuse.

This comment was marked as abuse.

Copy link
Contributor

@bboreham bboreham left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM apart from one point about redirecting errors from docker pull

@marccarre marccarre force-pushed the 2647-parallelise-setup branch from e834932 to 89e1169 Compare January 9, 2017 12:04
@marccarre
Copy link
Contributor Author

As suggested, I removed the redirect of stderr to /dev/null. I initially thought of simply removing any noise, but it is true that errors could still happen at this stage, in which case we may want to know what happened.

@marccarre marccarre removed their assignment Jan 9, 2017
@bboreham bboreham merged commit cef8c90 into master Jan 9, 2017
@marccarre marccarre deleted the 2647-parallelise-setup branch January 9, 2017 12:31
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants