Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable Network Selection in ROSA #44633

Closed
wants to merge 6 commits into from

Conversation

krishvoor
Copy link
Member

This PR will allow users to choose between OpenshiftSDN/ OVNKubernetes, always defaults to OVNKubernetes

This PR will allow users to choose between OpenshiftSDN/
OVNKubernetes, always defaults to OVNKubernetes

Signed-off-by: Krishna Harsha Voora <[email protected]>
@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Oct 20, 2023
@krishvoor
Copy link
Member Author

/pj-rehearse pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.13-nightly-x86-perfscale-rosa-multiaz-control-plane-3nodes

@krishvoor
Copy link
Member Author

/pj-rehearse periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.14-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic

@krishvoor
Copy link
Member Author

/pj-rehearse periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.12-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic

@krishvoor
Copy link
Member Author

/pj-rehearse periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.15-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 23, 2023

@krishvoor: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/rehearse/openshift-qe/ocp-qe-perfscale-ci/main/rosa-4.13-nightly-x86-perfscale-rosa-multiaz-control-plane-3nodes 8768908 link unknown /pj-rehearse pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.13-nightly-x86-perfscale-rosa-multiaz-control-plane-3nodes

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@krishvoor
Copy link
Member Author

The recent failure is not related to the PR in itself, but due to a Known bug, tracked via https://issues.redhat.com/browse/OCM-4433

@krishvoor krishvoor changed the title [WIP] Enable Network Selection in ROSA Enable Network Selection in ROSA Oct 23, 2023
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Oct 23, 2023
@krishvoor
Copy link
Member Author

/assign @jtaleric
/assign @svetsa-rh

@svetsa-rh
Copy link
Member

svetsa-rh commented Oct 23, 2023

There is a PR already in review for blocker bug, hoping that it will be merged soon so we can successfully run rehearsals before merging.

@krishvoor
Copy link
Member Author

Since the PR is now merged, running the rehearse

@krishvoor
Copy link
Member Author

/pj-rehearse periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.15-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic

@krishvoor
Copy link
Member Author

krishvoor commented Oct 23, 2023

The job here 4.15 CP Job has passed while passing OpenShiftSDN as network type.

From the scope of this PR, I'll revert 4.15 CP Job to normal

@krishvoor
Copy link
Member Author

@svetsa-rh - I have updated my commit, this is now good to merge

@krishvoor
Copy link
Member Author

/pj-rehearse ack

@openshift-ci-robot openshift-ci-robot added the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Oct 23, 2023
@svetsa-rh
Copy link
Member

/hold

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 24, 2023
@krishvoor
Copy link
Member Author

/hold
@svetsa-rh do you have any feedback for this?

@svetsa-rh
Copy link
Member

svetsa-rh commented Oct 24, 2023

The job here 4.15 CP Job has passed while passing OpenShiftSDN as network type.

From the scope of this PR, I'll revert 4.15 CP Job to normal

Harsha, from the log I see that it is an OVN cluster while it looks like you were expecting to test SDN.

"network": {
"host_prefix": 23,
"machine_cidr": "10.0.0.0/16",
"pod_cidr": "10.128.0.0/14",
"service_cidr": "172.30.0.0/16",
"type": "OVNKubernetes"
}

@svetsa-rh
Copy link
Member

Also, my suggestion is to add a new test(s) to this same PR to add SDN so it's easy to rehearse than reverting changes.

@jtaleric
Copy link
Contributor

      --no-proxy strings                                    A comma-separated list of destination domain names, domains, IP addresses or other network CIDRs to exclude proxying.
      --private-link                                        Provides private connectivity between VPCs, AWS services, and your on-premises networks, without exposing your traffic to the public internet.
jtaleric at polaris in ~/code/rosa on master $ ./rosa version
1.2.29
I: Your ROSA CLI is up to date.

I am not sure --network-type is valid?

ah, further investigation https://github.com/openshift/rosa/blob/master/cmd/create/cluster/cmd.go#L540-L547

https://github.com/openshift/rosa/blob/master/pkg/ocm/clusters.go#L45

Maybe this is a bug against ROSA cli?

@krishvoor
Copy link
Member Author

krishvoor commented Oct 29, 2023

      --no-proxy strings                                    A comma-separated list of destination domain names, domains, IP addresses or other network CIDRs to exclude proxying.
      --private-link                                        Provides private connectivity between VPCs, AWS services, and your on-premises networks, without exposing your traffic to the public internet.
jtaleric at polaris in ~/code/rosa on master $ ./rosa version
1.2.29
I: Your ROSA CLI is up to date.

I am not sure --network-type is valid?

ah, further investigation https://github.com/openshift/rosa/blob/master/cmd/create/cluster/cmd.go#L540-L547

https://github.com/openshift/rosa/blob/master/pkg/ocm/clusters.go#L45

More information in this doc

Maybe this is a bug against ROSA cli?

Looks like this will not be a supported option from 4.15 GA onwards, so the code changes might be aligned for the same.

@openshift-ci-robot openshift-ci-robot removed the rehearsals-ack Signifies that rehearsal jobs have been acknowledged label Oct 29, 2023
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 29, 2023

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: krishvoor
Once this PR has been reviewed and has the lgtm label, please ask for approval from jtaleric. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot
Copy link
Contributor

[REHEARSALNOTIFIER]
@krishvoor: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
pull-ci-openshift-aws-load-balancer-operator-main-e2e-aws-rosa-operator openshift/aws-load-balancer-operator presubmit Registry content changed
pull-ci-openshift-aws-load-balancer-operator-release-1.0-e2e-aws-rosa-operator openshift/aws-load-balancer-operator presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-ec-x86-perfscale-rosa-hcp-1zone-data-path-2nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.13-nightly-x86-perfscale-rosa-multiaz-control-plane-3nodes openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.13-nightly-x86-perfscale-rosa-multiaz-node-density-heavy-3nodes openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.13-nightly-x86-perfscale-rosa-multiaz-router-perf-3nodes openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.12-nightly-x86-perfscale-rosa-multiaz-cluster-density-v2-3nodes openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.12-nightly-x86-perfscale-rosa-multiaz-data-path-9nodes openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-nightly-x86-perfscale-rosa-hcp-1zone-data-path-2nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-ec-x86-perfscale-rosa-hcp-3zones-control-plane-24nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-ec-x86-perfscale-rosa-hcp-3zones-node-density-heavy-24nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-ec-x86-perfscale-rosa-hcp-3zones-node-density-cni-24nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-nightly-x86-perfscale-rosa-hcp-3zones-control-plane-24nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-nightly-x86-perfscale-rosa-hcp-3zones-node-density-heavy-24nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
pull-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.15-nightly-x86-perfscale-rosa-hcp-3zones-node-density-cni-24nodes-periodic openshift-qe/ocp-qe-perfscale-ci presubmit Registry content changed
periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.13-nightly-x86-perfscale-rosa-multiaz-node-density-cni-24nodes-periodic N/A periodic Registry content changed
periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.14-nightly-x86-perfscale-rosa-multiaz-control-plane-120nodes-periodic N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.14-amd64-nightly-aws-rosa-private-link-f7 N/A periodic Registry content changed
periodic-ci-jaegertracing-jaeger-operator-main-jaeger-product-hypershift-4.12-lp-rosa-hypershift-jaeger-product-rosa-hypershift-412 N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.14-amd64-stable-aws-rosa-sts-hypershift-sector-guest-prod-critical-f2 N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-master-rosacli-aws-rosa-non-sts-advanced-e2e-f3 N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.13-amd64-stable-aws-ocm-osd-ccs-fleet-manager-f7 N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.14-amd64-nightly-aws-rosa-sts-hypershift-guest-integration-full-f2 N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.14-amd64-nightly-aws-rosa-sts-hypershift-guest-stage-private-link-full-f2 N/A periodic Registry content changed
periodic-ci-quay-quay-tests-master-quay-rosa-ocp-quay-e2e-tests-quay39-rosa-ocp414 N/A periodic Registry content changed
periodic-ci-redhat-developer-service-binding-operator-release-v1.3.x-4.12-acceptance-lp-rosa-hypershift-412 N/A periodic Registry content changed
periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.15-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic N/A periodic Registry content changed
periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.14-ec-x86-perfscale-rosa-multiaz-ec-control-plane-24nodes-periodic N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.11-amd64-nightly-aws-rosa-sts-f28 N/A periodic Registry content changed
periodic-ci-redhat-chaos-krkn-hub-main-rosa-4.15-nightly-ocp-qe-perfscale-ci-tests-rosa-hog N/A periodic Registry content changed
periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa_hcp-4.13-nightly-x86-perfscale-rosa-hcp-3zones-node-density-heavy-24nodes-periodic N/A periodic Registry content changed
periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.15-nightly-x86-perfscale-rosa-multiaz-node-density-heavy-24nodes-periodic N/A periodic Registry content changed
periodic-ci-openshift-openshift-tests-private-release-4.15-amd64-nightly-aws-rosa-non-sts-advanced-f7 N/A periodic Registry content changed
periodic-ci-redhat-developer-service-binding-operator-release-v1.4.x-4.12-acceptance-lp-rosa-hypershift-412 N/A periodic Registry content changed
periodic-ci-rhpit-interop-tests-main-mtc-hypershift-4.12-lp-rosa-hypershift-mtc-aws-rosa-hypershift-412 N/A periodic Registry content changed

A total of 110 jobs have been affected by this change. The above listing is non-exhaustive and limited to 35 jobs.

A full list of affected jobs can be found here

Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 10 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 20 rehearsals
Comment: /pj-rehearse max to run up to 35 rehearsals
Comment: /pj-rehearse auto-ack to run up to 10 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse abort to abort all active rehearsals

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

@krishvoor
Copy link
Member Author

/pj-rehearse periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.12-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic

@krishvoor
Copy link
Member Author

Maybe this is a bug against ROSA cli?

/pj-rehearse periodic-ci-openshift-qe-ocp-qe-perfscale-ci-main-rosa-4.12-nightly-x86-perfscale-rosa-multiaz-control-plane-24nodes-periodic

I suspect this --network-type capability is stripped away in the latest rosa-cli code,
we will have to resort to a way where this can be tested against a desired/older rosa-cli binary.

@krishvoor
Copy link
Member Author

Based on conversation, we will be switching to Self-Managed AWS and make use of this option:
https://github.com/openshift/release/blob/master/ci-operator/step-registry/sdn/conf/sdn-conf-ref.yaml

@krishvoor krishvoor closed this Nov 6, 2023
@krishvoor krishvoor deleted the sdn-as-option branch November 6, 2023 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants