Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run v1alpha1 tests (and deploy DomainMapping component) in github actions #9837

Merged
merged 2 commits into from
Oct 15, 2020

Conversation

julz
Copy link
Member

@julz julz commented Oct 15, 2020

Since we'll be adding some tests to this suite gated by the enable-alpha flag as part of the DomainMapping work.

I think I'm holding GitHub actions right, but it's my first time trying so 🤷.

Example running on my fork here: https://github.com/julz/serving/runs/1258795911?check_suite_focus=true.

/assign @mattmoor @markusthoemmes

@google-cla google-cla bot added the cla: yes Indicates the PR's author has signed the CLA. label Oct 15, 2020
@knative-prow-robot knative-prow-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. area/test-and-release It flags unit/e2e/conformance/perf test issues for product features labels Oct 15, 2020
@codecov
Copy link

codecov bot commented Oct 15, 2020

Codecov Report

Merging #9837 into master will decrease coverage by 0.08%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #9837      +/-   ##
==========================================
- Coverage   87.72%   87.64%   -0.09%     
==========================================
  Files         180      180              
  Lines        8593     8593              
==========================================
- Hits         7538     7531       -7     
- Misses        805      808       +3     
- Partials      250      254       +4     
Impacted Files Coverage Δ
pkg/reconciler/configuration/configuration.go 85.24% <0.00%> (-4.10%) ⬇️
pkg/reconciler/autoscaling/kpa/scaler.go 88.57% <0.00%> (-1.43%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 5e6ab23...59fb7ba. Read the comment docs.

@julz
Copy link
Member Author

julz commented Oct 15, 2020

/retest

.github/workflows/kind-e2e.yaml Outdated Show resolved Hide resolved
.github/workflows/kind-e2e.yaml Outdated Show resolved Hide resolved
@coryrc
Copy link
Contributor

coryrc commented Oct 15, 2020

v1alpha1 was deleted in #9545

@julz
Copy link
Member Author

julz commented Oct 15, 2020

@coryrc it will be reintroduced in #9780.

@coryrc
Copy link
Contributor

coryrc commented Oct 15, 2020

oh, you have a new CRD with v1alpha1 version

I guess the infra should not have been ripped out if that was a possibility.

# This is explicitly added since we don't want to run every single matrix element twice.
- k8s-version: v1.19.1
test-suite: ./test/conformance/api/v1alpha1
test-flags: "--enable-alpha"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd expect us to just add this to existing configurations. I don't think that duplicating works properly based on prior experimentation 🤔

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

@julz julz Oct 15, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(it works because test-suite: ./test/conformance/api/v1alpha1 isn't in the existing matrix, so it's a new configuration, but there's really no point adding test-suite: ./test/conformance/api/v1alpha to the matrix since there's nothing in there that doesn't need the flag)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I was actually just coming back to leave that comment 🤣

I think what we really want is to add ./test/conformance/api/v1alpha1 to the test-suite list and then have a separate block with:

- test-suite: ./test/conformance/api/v1alpha1
  test-flags: --enable-alpha

This should give us a new leg for all K8s versions, which has the test-flags. If there are combinations that don't work, I believe we can exclude: them (likely with TODO(#1234) 🙏 ), but my preference would be to add this for as many as we can here.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

that's fine with me, I was guessing we'd want to limit the test explosion and only add for one combination (like we do with ingress), will update

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When I added these we had alpha and beta, so it's sort of a return to that, but with many fewer tests (this is doing to be so fast 😂 )

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rebased & updated, PTAL :)

@knative-prow-robot knative-prow-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Oct 15, 2020
@knative-prow-robot knative-prow-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Oct 15, 2020
@@ -43,6 +44,8 @@ jobs:
kind-version: v0.9.0
kind-image-sha: sha256:98cf5288864662e37115e362b23e4369c8c4a408f99cbc06e58ac30ddc721600
kingress: contour
- test-suite: ./test/conformance/api/v1alpha1
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: I'd put some space between the two blocks, since they act on different dimensions of the matrix

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍️ done.

@mattmoor
Copy link
Member

/retest

ControllerHA seems to be acting up 🤔

Copy link
Member

@mattmoor mattmoor left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@knative-prow-robot knative-prow-robot added the lgtm Indicates that a PR is ready to be merged. label Oct 15, 2020
@knative-prow-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: julz, mattmoor

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@knative-prow-robot knative-prow-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Oct 15, 2020
@knative-prow-robot knative-prow-robot merged commit ea9b9d9 into knative:master Oct 15, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/test-and-release It flags unit/e2e/conformance/perf test issues for product features cla: yes Indicates the PR's author has signed the CLA. lgtm Indicates that a PR is ready to be merged. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants