Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Travis: Don't run integration tests on every PR commit #3731

Merged
merged 2 commits into from
Feb 2, 2019

Conversation

phansch
Copy link
Member

@phansch phansch commented Feb 1, 2019

This does not save Clippy any time but it makes sure that the concurrent
build limit is not reached as quickly for the rust-lang Travis
account.

I can't create a permalink to the discussion somehow, so here's an
excerpt from the Infra channel:

[11:57 PM] pietroalbini: there is a clippy build (20 jobs) and a packed_simd one (42 builders)  and a rustc one which isn't scheduling atm
[11:58 PM] pietroalbini: I don't think there is a way to prioritize rustc builds in the queue on travis, right?
[12:22 AM] alexcrichton: pietro: I don't think so no
[12:22 AM] alexcrichton: If it's a problem we should cull builds on other projects
[12:22 AM] alexcrichton: The rust repo is the #1 priority

Since the integration tests are rarely failing these days, I think it's
fine to not run them on every commit.

If needed, it's also still possible to do a complete test run with @bors try.

This does not save Clippy any time but it makes sure that the concurrent
build limit is not reached as quickly for the `rust-lang` Travis
account.

I can't create a permalink to the discussion somehow, so here's an
excerpt from the Infra channel:

```
[11:57 PM] pietroalbini: there is a clippy build (20 jobs) and a packed_simd one (42 builders)  and a rustc one which isn't scheduling atm
[11:58 PM] pietroalbini: I don't think there is a way to prioritize rustc builds in the queue on travis, right?
[12:22 AM] alexcrichton: pietro: I don't think so no
[12:22 AM] alexcrichton: If it's a problem we should cull builds on other projects
[12:22 AM] alexcrichton: The rust repo is the #1 priority
```

Since the integration tests are rarely failing these days, I think it's
fine to not run them on every commit.

If needed, it's also still possible to do a `try` build with `@bors try`.
@phansch
Copy link
Member Author

phansch commented Feb 1, 2019

If the configured .travis.yml is setup correctly it should behave like this:

  1. Normal commits should just trigger the linux, mac and windows build: link
  2. A bors try should trigger all builds: link
  3. A bors r+ should trigger all builds

@phansch
Copy link
Member Author

phansch commented Feb 1, 2019

@bors try

@bors
Copy link
Contributor

bors commented Feb 1, 2019

⌛ Trying commit 4e39e65 with merge cadf7d7...

bors added a commit that referenced this pull request Feb 1, 2019
Travis: Don't run integration tests on every PR commit

This does not save Clippy any time but it makes sure that the concurrent
build limit is not reached as quickly for the `rust-lang` Travis
account.

I can't create a permalink to the discussion somehow, so here's an
excerpt from the Infra channel:

```
[11:57 PM] pietroalbini: there is a clippy build (20 jobs) and a packed_simd one (42 builders)  and a rustc one which isn't scheduling atm
[11:58 PM] pietroalbini: I don't think there is a way to prioritize rustc builds in the queue on travis, right?
[12:22 AM] alexcrichton: pietro: I don't think so no
[12:22 AM] alexcrichton: If it's a problem we should cull builds on other projects
[12:22 AM] alexcrichton: The rust repo is the #1 priority
```

Since the integration tests are rarely failing these days, I think it's
fine to not run them on every commit.

If needed, it's also still possible to do a `try` build with `@bors try`.
@phansch phansch added the S-waiting-on-review Status: Awaiting review from the assignee but also interested parties label Feb 1, 2019
@bors
Copy link
Contributor

bors commented Feb 1, 2019

☀️ Test successful - checks-travis, status-appveyor
State: approved= try=True

@mati865
Copy link
Contributor

mati865 commented Feb 1, 2019

Does bots support any other CI apart from Appveryor?
If so those tests could be moved there.

@phansch
Copy link
Member Author

phansch commented Feb 1, 2019

The homu/bors readme says that it only supports TravisCI, AppVeyor and Buildbot. Since buildbot would require custom infrastructure, I think that's not something we can do.

We _always_ want to execute these, also on the master branch.
@mati865
Copy link
Contributor

mati865 commented Feb 1, 2019

It's possible to run Buildbot on Amazon EC2 (750 hours per month, 12 months for free) but I'm not sure if they would consider Clippy as a project standalone from Rust.

Reducing amount of jobs seems to be the best solution for now, have my +1.

@phansch
Copy link
Member Author

phansch commented Feb 1, 2019

@bors r+

@bors
Copy link
Contributor

bors commented Feb 1, 2019

📌 Commit 69d96c7 has been approved by phansch

@bors
Copy link
Contributor

bors commented Feb 2, 2019

⌛ Testing commit 69d96c7 with merge 9f88641...

bors added a commit that referenced this pull request Feb 2, 2019
Travis: Don't run integration tests on every PR commit

This does not save Clippy any time but it makes sure that the concurrent
build limit is not reached as quickly for the `rust-lang` Travis
account.

I can't create a permalink to the discussion somehow, so here's an
excerpt from the Infra channel:

```
[11:57 PM] pietroalbini: there is a clippy build (20 jobs) and a packed_simd one (42 builders)  and a rustc one which isn't scheduling atm
[11:58 PM] pietroalbini: I don't think there is a way to prioritize rustc builds in the queue on travis, right?
[12:22 AM] alexcrichton: pietro: I don't think so no
[12:22 AM] alexcrichton: If it's a problem we should cull builds on other projects
[12:22 AM] alexcrichton: The rust repo is the #1 priority
```

Since the integration tests are rarely failing these days, I think it's
fine to not run them on every commit.

If needed, it's also still possible to do a complete test run with `@bors try`.
@bors
Copy link
Contributor

bors commented Feb 2, 2019

☀️ Test successful - checks-travis, status-appveyor
Approved by: phansch
Pushing 9f88641 to master...

@bors bors merged commit 69d96c7 into rust-lang:master Feb 2, 2019
@phansch phansch deleted the travis branch February 2, 2019 08:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-review Status: Awaiting review from the assignee but also interested parties
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants