10 fail, 6 skipped, 87 pass in 3h 36m 6s
Annotations
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
3 out of 7 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeight (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 14s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 13s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 14s]
Raw output
Failed
=== RUN TestAWSSuite/TestALBExperimentStepNoSetWeight
time="2023-11-01T00:32:34Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
time="2023-11-01T00:32:34Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-11-01T00:32:34Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-11-01T00:32:35Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-11-01T00:32:35Z" level=info msg="ingress.networking.k8s.io/alb-rollout-ingress created\n" rollout=alb-rollout
time="2023-11-01T00:32:35Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-11-01T00:32:35Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-11-01T00:32:36Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=alb-rollout
time="2023-11-01T00:32:36Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-11-01T00:32:36Z" level=info msg="Updated rollout pod spec: 2023-11-01T00:32:36.729919649Z" rollout=alb-rollout
time="2023-11-01T00:32:36Z" level=info msg="Sleeping 10s" rollout=alb-rollout
require.go:72:
Error Trace: /home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:264
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:254
Error: Not equal:
expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
actual : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
Diff:
--- Expected
+++ Actual
@@ -1 +1 @@
-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
Test: TestAWSSuite/TestALBExperimentStepNoSetWeight
Name: alb-rollout
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/1
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 0
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ alb-rollout Rollout �[94m◌�[0m Progressing 11s
├──# revision:2
│ ├──⧉ �[33malb-rollout-6856d7d648�[0m ReplicaSet �[0m•�[0m ScaledDown 10s �[33mcanary�[0m
│ └──Σ �[94malb-rollout-6856d7d648-2-0�[0m Experiment �[94m◌�[0m Running 10s
│ ├──⧉ alb-rollout-6856d7d648-2-0-experiment-alb-canary ReplicaSet �[32m✔�[0m Healthy 10s
│ │ └──□ alb-rollout-6856d7d648-2-0-experiment-alb-canary-8kqq2 Pod �[32m✔�[0m Running 10s ready:1/1
│ └──⧉ alb-rollout-6856d7d648-2-0-experiment-alb-stable ReplicaSet �[32m✔�[0m Healthy 10s
│ └──□ alb-rollout-6856d7d648-2-0-experiment-alb-stable-hnw6d Pod �[32m✔�[0m Running 10s ready:1/1
└──# revision:1
└──⧉ �[32malb-rollout-d6f4fdcdc�[0m ReplicaSet �[32m✔�[0m Healthy 11s �[32mstable�[0m
└──□ alb-rollout-d6f4fdcdc-2lkgl Pod �[32m✔�[0m Running 11s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-11-01T00:32:35Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestALBExperimentStepNoSetWeight
name: alb-rollout
namespace: default
resourceVersion: "3968"
uid: 5e7402cf-174d-4c02-9ac7-dc9aa16b0582
spec:
replicas: 1
selector:
matchLabels:
app: alb-rollout
strategy:
canary:
canaryService: alb-rollout-canary
stableService: alb-rollout-stable
steps:
- experiment:
duration: 15s
templates:
- metadata: {}
name: experiment-alb-canary
specRef: canary
weight: 20
- metadata: {}
name: experiment-alb-stable
specRef: stable
weight: 20
trafficRouting:
alb:
ingress: alb-rollout-ingress
rootService: alb-rollout-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-11-01T00:32:36.729919649Z"
creationTimestamp: null
labels:
app: alb-rollout
spec:
containers:
- image: nginx:1.19-alpine
name: alb-rollout
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen: {}
canary:
currentExperiment: alb-rollout-6856d7d648-2-0
weights:
additional:
- weight: 20
- weight: 20
canary:
podTemplateHash: 6856d7d648
serviceName: alb-rollout-canary
weight: 0
stable:
podTemplateHash: d6f4fdcdc
serviceName: alb-rollout-stable
weight: 60
conditions:
- lastTransitionTime: "2023-11-01T00:32:36Z"
lastUpdateTime: "2023-11-01T00:32:36Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-11-01T00:32:36Z"
lastUpdateTime: "2023-11-01T00:32:36Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-11-01T00:32:36Z"
lastUpdateTime: "2023-11-01T00:32:36Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-11-01T00:32:35Z"
lastUpdateTime: "2023-11-01T00:32:36Z"
message: Created new replica set "alb-rollout-6856d7d648"
reason: NewReplicaSetCreated
status: "True"
type: Progressing
currentPodHash: 6856d7d648
currentStepHash: 558cc8bf4d
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "3"
phase: Progressing
readyReplicas: 1
replicas: 1
selector: app=alb-rollout
stableRS: d6f4fdcdc
2023-11-01T00:32:35Z Normal RolloutAddedToInformer Rollout resource added to informer: default/alb-rollout
2023-11-01T00:32:35Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-11-01T00:32:35Z Normal RolloutUpdated Rollout updated to revision 1
2023-11-01T00:32:35Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-11-01T00:32:35Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-11-01T00:32:35Z Normal ScalingReplicaSet Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-11-01T00:32:35Z Normal RolloutCompleted Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-11-01T00:32:36Z Normal SwitchService Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-11-01T00:32:36Z Normal SwitchService Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-11-01T00:32:36Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (6856d7d648)
2023-11-01T00:32:36Z Normal RolloutUpdated Rollout updated to revision 2
2023-11-01T00:32:36Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-6856d7d648 (revision 2)
2023-11-01T00:32:36Z (x2) Normal TrafficWeightUpdated Traffic weight updated
2023-11-01T00:32:36Z Normal ExperimentCreated Created Experiment 'alb-rollout-6856d7d648-2-0'
2023-11-01T00:32:38Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-ingress` to desiredWeight '0'
2023-11-01T00:32:38Z Normal TrafficWeightUpdated Traffic weight updated additional: [{20 } {20 }]
time="2023-11-01T00:32:46Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeight"
--- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeight (13.06s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
3 out of 8 runs failed: TestAWSSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 2m 6s]
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 2m 3s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 1m 59s]
Raw output
Failed
=== RUN TestAWSSuite
--- FAIL: TestAWSSuite (123.10s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestRollbackSuite/TestRollbackAnalysisOutsideWindow (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 35s]
Raw output
Failed
=== RUN TestRollbackSuite/TestRollbackAnalysisOutsideWindow
time="2023-11-01T00:51:31Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
time="2023-11-01T00:51:32Z" level=info msg="rollout.argoproj.io/window configured\n" rollout=window
time="2023-11-01T00:51:32Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-11-01T00:51:40Z" level=info msg="Condition 'status=Healthy' met after 8s" rollout=window
time="2023-11-01T00:51:40Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-11-01T00:51:40Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-11-01T00:51:47Z" level=info msg="Condition 'status=Healthy' met after 7s" rollout=window
time="2023-11-01T00:51:47Z" level=info msg="AnalysisRun expectation 'analysisrun count == 1' met" rollout=window
time="2023-11-01T00:51:47Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"three\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"three\"}}}}}" rollout=window
time="2023-11-01T00:51:47Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-11-01T00:51:53Z" level=info msg="Condition 'status=Healthy' met after 6s" rollout=window
time="2023-11-01T00:51:53Z" level=info msg="AnalysisRun expectation 'analysisrun count == 2' met" rollout=window
time="2023-11-01T00:51:53Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"four\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"four\"}}}}}" rollout=window
time="2023-11-01T00:51:53Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-11-01T00:51:59Z" level=info msg="Condition 'status=Healthy' met after 5s" rollout=window
time="2023-11-01T00:51:59Z" level=info msg="AnalysisRun expectation 'analysisrun count == 3' met" rollout=window
time="2023-11-01T00:51:59Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"five\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"five\"}}}}}" rollout=window
time="2023-11-01T00:52:00Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-11-01T00:52:06Z" level=info msg="Condition 'status=Healthy' met after 6s" rollout=window
time="2023-11-01T00:52:06Z" level=info msg="AnalysisRun expectation 'analysisrun count == 4' met" rollout=window
time="2023-11-01T00:52:06Z" level=info msg="Updated rollout spec: {\"metadata\":{\"labels\":{\"rev\":\"two\"}},\"spec\":{\"template\":{\"metadata\":{\"labels\":{\"rev\":\"two\"}}}}}" rollout=window
time="2023-11-01T00:52:06Z" level=info msg="Waiting for condition: status=Healthy" rollout=window
time="2023-11-01T00:52:06Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=window
time="2023-11-01T00:52:06Z" level=error msg="AnalysisRun expectation 'analysisrun count == 5' failed" rollout=window
Name: window
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/2
SetWeight: 50
ActualWeight: 0
Images: nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
Desired: 2
Current: 3
Updated: 1
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ window Rollout �[94m◌�[0m Progressing 35s
├──# revision:6
│ └──⧉ �[33mwindow-5658c69dbb�[0m ReplicaSet �[94m◌�[0m Progressing 26s �[33mcanary�[0m
│ └──□ window-5658c69dbb-6mmdr Pod �[94m◌�[0m Pending 0s ready:0/1
├──# revision:5
│ ├──⧉ �[32mwindow-8458dcdd5b�[0m ReplicaSet �[32m✔�[0m Healthy 6s �[32mstable�[0m
│ │ ├──□ window-8458dcdd5b-slcmd Pod �[32m✔�[0m Running 6s ready:1/1
│ │ └──□ window-8458dcdd5b-tg2gb Pod �[32m✔�[0m Running 2s ready:1/1
│ └──α �[0mwindow-8458dcdd5b-5-1�[0m AnalysisRun �[32m✔�[0m Successful 5s �[32m✔�[0m 1
│ └──⊞ �[0m50d21206-7bf4-4829-bbbd-bb9b69ad8f61.sleep-job.1�[0m Job �[32m✔�[0m Successful 5s
├──# revision:4
│ ├──⧉ window-cd5644b76 ReplicaSet �[0m•�[0m ScaledDown 12s
│ │ └──□ window-cd5644b76-qxghm Pod �[94m◌�[0m Terminating 12s ready:1/1
│ └──α �[0mwindow-cd5644b76-4-1�[0m AnalysisRun �[32m✔�[0m Successful 11s �[32m✔�[0m 1
│ └──⊞ �[0m6cb1de27-f087-448b-a7d1-0a8309c0e466.sleep-job.1�[0m Job �[32m✔�[0m Successful 11s
├──# revision:3
│ ├──⧉ window-6458bcd6fb ReplicaSet �[0m•�[0m ScaledDown 19s
│ └──α �[0mwindow-6458bcd6fb-3-1�[0m AnalysisRun �[32m✔�[0m Successful 18s �[32m✔�[0m 1
│ └──⊞ �[0m348027d2-8c60-4a92-90ae-9c07a88e705c.sleep-job.1�[0m Job �[32m✔�[0m Successful 18s
├──# revision:2
│ └──α �[0mwindow-5658c69dbb-2-1�[0m AnalysisRun �[32m✔�[0m Successful 25s �[32m✔�[0m 1
│ └──⊞ �[0m6c0449f8-fdeb-4983-a68d-5cccb8167fb1.sleep-job.1�[0m Job �[32m✔�[0m Successful 25s
└──# revision:1
└──⧉ window-c64cf84f6 ReplicaSet �[0m•�[0m ScaledDown 35s
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "5"
creationTimestamp: "2023-11-01T00:51:31Z"
generation: 9
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestRollbackAnalysisOutsideWindow
rev: two
name: window
namespace: default
resourceVersion: "16730"
uid: 4b337abf-795d-4401-b1ca-63428b8eff84
spec:
replicas: 2
rollbackWindow:
revisions: 2
selector:
matchLabels:
app: window
strategy:
canary:
steps:
- setWeight: 50
- analysis:
analysisRunMetadata: {}
args:
- name: rev
valueFrom:
fieldRef:
fieldPath: metadata.labels['rev']
templates:
- templateName: sleep-job
template:
metadata:
creationTimestamp: null
labels:
app: window
rev: two
spec:
containers:
- image: nginx:1.19-alpine
name: basic
resources:
requests:
cpu: 1m
memory: 16Mi
status:
HPAReplicas: 2
availableReplicas: 2
blueGreen: {}
canary: {}
conditions:
- lastTransitionTime: "2023-11-01T00:51:40Z"
lastUpdateTime: "2023-11-01T00:51:40Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-11-01T00:52:05Z"
lastUpdateTime: "2023-11-01T00:52:05Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
- lastTransitionTime: "2023-11-01T00:52:05Z"
lastUpdateTime: "2023-11-01T00:52:05Z"
message: Rollout is healthy
reason: RolloutHealthy
status: "True"
type: Healthy
- lastTransitionTime: "2023-11-01T00:51:31Z"
lastUpdateTime: "2023-11-01T00:52:05Z"
message: ReplicaSet "window-8458dcdd5b" has successfully progressed.
reason: NewReplicaSetAvailable
status: "True"
type: Progressing
currentPodHash: 8458dcdd5b
currentStepHash: 7dd87d6d74
currentStepIndex: 2
observedGeneration: "8"
phase: Healthy
readyReplicas: 2
replicas: 2
selector: app=window
stableRS: 8458dcdd5b
updatedReplicas: 2
2023-11-01T00:51:31Z Normal RolloutAddedToInformer Rollout resource added to informer: default/window
2023-11-01T00:51:31Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (c64cf84f6)
2023-11-01T00:51:31Z Normal RolloutUpdated Rollout updated to revision 1
2023-11-01T00:51:31Z Normal NewReplicaSetCreated Created ReplicaSet window-c64cf84f6 (revision 1)
2023-11-01T00:51:31Z Normal ScalingReplicaSet Scaled up ReplicaSet window-c64cf84f6 (revision 1) from 0 to 2
2023-11-01T00:51:31Z Normal RolloutCompleted Rollout completed update to revision 1 (c64cf84f6): Initial deploy
2023-11-01T00:51:40Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (5658c69dbb)
2023-11-01T00:51:40Z Normal RolloutUpdated Rollout updated to revision 2
2023-11-01T00:51:40Z Normal NewReplicaSetCreated Created ReplicaSet window-5658c69dbb (revision 2)
2023-11-01T00:51:40Z Normal ScalingReplicaSet Scaled up ReplicaSet window-5658c69dbb (revision 2) from 0 to 1
2023-11-01T00:51:41Z Normal ScalingReplicaSet Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 2 to 1
2023-11-01T00:51:41Z Normal AnalysisRunRunning Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Running' Previous: ''
2023-11-01T00:51:46Z Normal AnalysisRunSuccessful Step Analysis Run 'window-5658c69dbb-2-1' Status New: 'Successful' Previous: 'Running'
2023-11-01T00:51:46Z Normal RolloutStepCompleted Rollout step 2/2 completed (analysis)
2023-11-01T00:51:46Z Normal ScalingReplicaSet Scaled up ReplicaSet window-5658c69dbb (revision 2) from 1 to 2
2023-11-01T00:51:47Z Normal ScalingReplicaSet Scaled down ReplicaSet window-c64cf84f6 (revision 1) from 1 to 0
2023-11-01T00:51:47Z Normal RolloutCompleted Rollout completed update to revision 2 (5658c69dbb): Completed all 2 canary steps
2023-11-01T00:51:47Z Normal RolloutNotCompleted Rollout not completed, started update to revision 3 (6458bcd6fb)
2023-11-01T00:51:48Z Normal RolloutUpdated Rollout updated to revision 3
2023-11-01T00:51:48Z Normal NewReplicaSetCreated Created ReplicaSet window-6458bcd6fb (revision 3)
2023-11-01T00:51:48Z Normal ScalingReplicaSet Scaled up ReplicaSet window-6458bcd6fb (revision 3) from 0 to 1
2023-11-01T00:51:48Z Normal ScalingReplicaSet Scaled down ReplicaSet window-5658c69dbb (revision 2) from 2 to 1
2023-11-01T00:51:48Z (x2) Normal RolloutStepCompleted Rollout step 1/2 completed (setWeight: 50)
2023-11-01T00:51:49Z Normal AnalysisRunRunning Step Analysis Run 'window-6458bcd6fb-3-1' Status New: 'Running' Previous: ''
time="2023-11-01T00:52:06Z" level=info msg="Deleting e2e-test-name=TestRollbackAnalysisOutsideWindow"
--- FAIL: TestRollbackSuite/TestRollbackAnalysisOutsideWindow (35.03s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestRollbackSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.25)/junit.xml [took 1m 2s]
Raw output
Failed
=== RUN TestRollbackSuite
time="2023-11-01T00:51:31Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-11-01T00:51:31Z" level=info msg="rollout.argoproj.io/window created\n"
--- FAIL: TestRollbackSuite (62.00s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 4s]
Raw output
Failed
=== RUN TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
time="2023-11-01T00:30:34Z" level=info msg="Deleting e2e-test-name=TestCanaryFailInlineMultipleAnalysis"
time="2023-11-01T00:30:34Z" level=info msg="rollout.argoproj.io/rollout-inline-analysis created\n" rollout=rollout-inline-analysis
time="2023-11-01T00:30:34Z" level=info msg="Waiting for condition: status=Healthy" rollout=rollout-inline-analysis
time="2023-11-01T00:30:36Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=rollout-inline-analysis
time="2023-11-01T00:30:36Z" level=info msg="AnalysisRun expectation 'analysisrun count == 0' met" rollout=rollout-inline-analysis
time="2023-11-01T00:30:36Z" level=info msg="Updated rollout pod spec: 2023-11-01T00:30:36.323509276Z" rollout=rollout-inline-analysis
time="2023-11-01T00:30:36Z" level=info msg="Waiting for condition: status=Paused" rollout=rollout-inline-analysis
time="2023-11-01T00:30:37Z" level=info msg="Condition 'status=Paused' met after 1s" rollout=rollout-inline-analysis
time="2023-11-01T00:30:37Z" level=info msg="Promoted rollout" rollout=rollout-inline-analysis
time="2023-11-01T00:30:37Z" level=info msg="Sleeping 1s" rollout=rollout-inline-analysis
time="2023-11-01T00:30:38Z" level=info msg="Rollout expectation status=Progressing met" rollout=rollout-inline-analysis
time="2023-11-01T00:30:38Z" level=error msg="Inline AnalysisRun not found" rollout=rollout-inline-analysis
Name: rollout-inline-analysis
Namespace: default
Status: �[94m◌�[0m Progressing
Message: waiting for rollout to unpause
Strategy: Canary
Step: 1/3
SetWeight: 10
ActualWeight: 50
Images: nginx:1.19-alpine (�[33mcanary�[0m, �[32mstable�[0m)
Replicas:
Desired: 1
Current: 2
Updated: 1
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ rollout-inline-analysis Rollout �[94m◌�[0m Progressing 4s
├──# revision:2
│ └──⧉ �[33mrollout-inline-analysis-76d9474f99�[0m ReplicaSet �[32m✔�[0m Healthy 2s �[33mcanary�[0m
│ └──□ rollout-inline-analysis-76d9474f99-l6cm5 Pod �[32m✔�[0m Running 2s ready:1/1
└──# revision:1
└──⧉ �[32mrollout-inline-analysis-5b9ffdfd5�[0m ReplicaSet �[32m✔�[0m Healthy 4s �[32mstable�[0m
└──□ rollout-inline-analysis-5b9ffdfd5-9hpn5 Pod �[32m✔�[0m Running 4s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-11-01T00:30:34Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryFailInlineMultipleAnalysis
name: rollout-inline-analysis
namespace: default
resourceVersion: "2541"
uid: 0ea39f6e-80a0-4eff-8c03-0718b9ec137f
spec:
replicas: 1
selector:
matchLabels:
app: rollout-inline-analysis
strategy:
canary:
steps:
- setWeight: 10
- pause: {}
- analysis:
analysisRunMetadata: {}
templates:
- templateName: multiple-job-fail
template:
metadata:
annotations:
update: "2023-11-01T00:30:36.323509276Z"
creationTimestamp: null
labels:
app: rollout-inline-analysis
spec:
containers:
- image: nginx:1.19-alpine
name: rollouts-demo
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 2
availableReplicas: 2
blueGreen: {}
canary: {}
conditions:
- lastTransitionTime: "2023-11-01T00:30:36Z"
lastUpdateTime: "2023-11-01T00:30:36Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-11-01T00:30:36Z"
lastUpdateTime: "2023-11-01T00:30:36Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-11-01T00:30:36Z"
lastUpdateTime: "2023-11-01T00:30:36Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-11-01T00:30:37Z"
lastUpdateTime: "2023-11-01T00:30:37Z"
message: Rollout is paused
reason: RolloutPaused
status: Unknown
type: Progressing
- lastTransitionTime: "2023-11-01T00:30:37Z"
lastUpdateTime: "2023-11-01T00:30:37Z"
message: Rollout is paused
reason: RolloutPaused
status: "True"
type: Paused
controllerPause: true
currentPodHash: 76d9474f99
currentStepHash: 5d965587f9
currentStepIndex: 1
message: CanaryPauseStep
observedGeneration: "3"
phase: Paused
readyReplicas: 2
replicas: 2
selector: app=rollout-inline-analysis
stableRS: 5b9ffdfd5
updatedReplicas: 1
2023-11-01T00:30:34Z Normal RolloutAddedToInformer Rollout resource added to informer: default/rollout-inline-analysis
2023-11-01T00:30:34Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (5b9ffdfd5)
2023-11-01T00:30:34Z Normal RolloutUpdated Rollout updated to revision 1
2023-11-01T00:30:34Z Normal NewReplicaSetCreated Created ReplicaSet rollout-inline-analysis-5b9ffdfd5 (revision 1)
2023-11-01T00:30:34Z Normal ScalingReplicaSet Scaled up ReplicaSet rollout-inline-analysis-5b9ffdfd5 (revision 1) from 0 to 1
2023-11-01T00:30:34Z Normal RolloutCompleted Rollout completed update to revision 1 (5b9ffdfd5): Initial deploy
2023-11-01T00:30:36Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (76d9474f99)
2023-11-01T00:30:36Z Normal RolloutUpdated Rollout updated to revision 2
2023-11-01T00:30:36Z Normal NewReplicaSetCreated Created ReplicaSet rollout-inline-analysis-76d9474f99 (revision 2)
2023-11-01T00:30:36Z Normal ScalingReplicaSet Scaled up ReplicaSet rollout-inline-analysis-76d9474f99 (revision 2) from 0 to 1
2023-11-01T00:30:37Z Normal RolloutStepCompleted Rollout step 1/3 completed (setWeight: 10)
2023-11-01T00:30:37Z Normal RolloutPaused Rollout is paused (CanaryPauseStep)
time="2023-11-01T00:30:39Z" level=info msg="Deleting e2e-test-name=TestCanaryFailInlineMultipleAnalysis"
--- FAIL: TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis (4.77s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestAnalysisSuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 4m 25s]
Raw output
Failed
=== RUN TestAnalysisSuite
time="2023-11-01T00:26:52Z" level=info msg="analysistemplate.argoproj.io/web-background created\n"
time="2023-11-01T00:26:52Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
time="2023-11-01T00:26:53Z" level=info msg="analysistemplate.argoproj.io/multiple-job created\n"
time="2023-11-01T00:26:53Z" level=info msg="analysistemplate.argoproj.io/multiple-job-fail created\n"
--- FAIL: TestAnalysisSuite (265.55s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 14s]
Raw output
Failed
=== RUN TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
time="2023-11-01T00:33:16Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
time="2023-11-01T00:33:17Z" level=info msg="service/alb-rollout-root created\n" rollout=alb-rollout
time="2023-11-01T00:33:17Z" level=info msg="service/alb-rollout-canary created\n" rollout=alb-rollout
time="2023-11-01T00:33:17Z" level=info msg="service/alb-rollout-stable created\n" rollout=alb-rollout
time="2023-11-01T00:33:18Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-1 created\n" rollout=alb-rollout
time="2023-11-01T00:33:18Z" level=info msg="ingress.networking.k8s.io/alb-rollout-multi-ingress-2 created\n" rollout=alb-rollout
time="2023-11-01T00:33:18Z" level=info msg="rollout.argoproj.io/alb-rollout created\n" rollout=alb-rollout
time="2023-11-01T00:33:18Z" level=info msg="Waiting for condition: status=Healthy" rollout=alb-rollout
time="2023-11-01T00:33:19Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=alb-rollout
time="2023-11-01T00:33:19Z" level=info msg="Experiment expectation 'experiment count == 0' met" rollout=alb-rollout
time="2023-11-01T00:33:19Z" level=info msg="Updated rollout pod spec: 2023-11-01T00:33:19.910066718Z" rollout=alb-rollout
time="2023-11-01T00:33:19Z" level=info msg="Sleeping 10s" rollout=alb-rollout
require.go:72:
Error Trace: /home/runner/go/pkg/mod/github.com/tj/[email protected]/require.go:72
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:298
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/aws_test.go:287
Error: Not equal:
expected: "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"\",\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
actual : "{\"Type\":\"forward\",\"ForwardConfig\":{\"TargetGroups\":[{\"ServiceName\":\"alb-rollout-canary\",\"ServicePort\":\"80\",\"Weight\":0},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServicePort\":\"80\",\"Weight\":20},{\"ServiceName\":\"alb-rollout-stable\",\"ServicePort\":\"80\",\"Weight\":60}]}}"
Diff:
--- Expected
+++ Actual
@@ -1 +1 @@
-{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"","ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
+{"Type":"forward","ForwardConfig":{"TargetGroups":[{"ServiceName":"alb-rollout-canary","ServicePort":"80","Weight":0},{"ServicePort":"80","Weight":20},{"ServicePort":"80","Weight":20},{"ServiceName":"alb-rollout-stable","ServicePort":"80","Weight":60}]}}
Test: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
Name: alb-rollout
Namespace: default
Status: �[94m◌�[0m Progressing
Message: more replicas need to be updated
Strategy: Canary
Step: 0/1
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m, �[0mΣ:experiment-alb-canary�[0m, �[0mΣ:experiment-alb-stable�[0m)
Replicas:
Desired: 1
Current: 1
Updated: 0
Ready: 1
Available: 1
NAME KIND STATUS AGE INFO
⟳ alb-rollout Rollout �[94m◌�[0m Progressing 12s
├──# revision:2
│ ├──⧉ �[33malb-rollout-5c88b985b6�[0m ReplicaSet �[0m•�[0m ScaledDown 11s �[33mcanary�[0m
│ └──Σ �[94malb-rollout-5c88b985b6-2-0�[0m Experiment �[94m◌�[0m Running 11s
│ ├──⧉ alb-rollout-5c88b985b6-2-0-experiment-alb-canary ReplicaSet �[32m✔�[0m Healthy 11s
│ │ └──□ alb-rollout-5c88b985b6-2-0-experiment-alb-canary-42lt2 Pod �[32m✔�[0m Running 10s ready:1/1
│ └──⧉ alb-rollout-5c88b985b6-2-0-experiment-alb-stable ReplicaSet �[32m✔�[0m Healthy 11s
│ └──□ alb-rollout-5c88b985b6-2-0-experiment-alb-stable-4rbx6 Pod �[32m✔�[0m Running 10s ready:1/1
└──# revision:1
└──⧉ �[32malb-rollout-d6f4fdcdc�[0m ReplicaSet �[32m✔�[0m Healthy 12s �[32mstable�[0m
└──□ alb-rollout-d6f4fdcdc-gc4xg Pod �[32m✔�[0m Running 12s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-11-01T00:33:18Z"
generation: 3
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestALBExperimentStepNoSetWeightMultiIngress
name: alb-rollout
namespace: default
resourceVersion: "4227"
uid: 5e0410dc-5b23-4448-906e-dbe3215821a8
spec:
replicas: 1
selector:
matchLabels:
app: alb-rollout
strategy:
canary:
canaryService: alb-rollout-canary
stableService: alb-rollout-stable
steps:
- experiment:
duration: 15s
templates:
- metadata: {}
name: experiment-alb-canary
specRef: canary
weight: 20
- metadata: {}
name: experiment-alb-stable
specRef: stable
weight: 20
trafficRouting:
alb:
ingresses:
- alb-rollout-multi-ingress-1
- alb-rollout-multi-ingress-2
rootService: alb-rollout-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-11-01T00:33:19.910066718Z"
creationTimestamp: null
labels:
app: alb-rollout
spec:
containers:
- image: nginx:1.19-alpine
name: alb-rollout
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 1
availableReplicas: 1
blueGreen: {}
canary:
currentExperiment: alb-rollout-5c88b985b6-2-0
weights:
additional:
- weight: 20
- weight: 20
canary:
podTemplateHash: 5c88b985b6
serviceName: alb-rollout-canary
weight: 0
stable:
podTemplateHash: d6f4fdcdc
serviceName: alb-rollout-stable
weight: 60
conditions:
- lastTransitionTime: "2023-11-01T00:33:19Z"
lastUpdateTime: "2023-11-01T00:33:19Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-11-01T00:33:19Z"
lastUpdateTime: "2023-11-01T00:33:19Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-11-01T00:33:19Z"
lastUpdateTime: "2023-11-01T00:33:19Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-11-01T00:33:18Z"
lastUpdateTime: "2023-11-01T00:33:19Z"
message: Created new replica set "alb-rollout-5c88b985b6"
reason: NewReplicaSetCreated
status: "True"
type: Progressing
currentPodHash: 5c88b985b6
currentStepHash: 558cc8bf4d
currentStepIndex: 0
message: more replicas need to be updated
observedGeneration: "3"
phase: Progressing
readyReplicas: 1
replicas: 1
selector: app=alb-rollout
stableRS: d6f4fdcdc
2023-11-01T00:33:18Z Normal RolloutAddedToInformer Rollout resource added to informer: default/alb-rollout
2023-11-01T00:33:18Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (d6f4fdcdc)
2023-11-01T00:33:18Z Normal RolloutUpdated Rollout updated to revision 1
2023-11-01T00:33:18Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-d6f4fdcdc (revision 1)
2023-11-01T00:33:18Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-11-01T00:33:18Z Normal ScalingReplicaSet Scaled up ReplicaSet alb-rollout-d6f4fdcdc (revision 1) from 0 to 1
2023-11-01T00:33:18Z Normal RolloutCompleted Rollout completed update to revision 1 (d6f4fdcdc): Initial deploy
2023-11-01T00:33:19Z Normal SwitchService Switched selector for service 'alb-rollout-stable' from '' to 'd6f4fdcdc'
2023-11-01T00:33:19Z Normal SwitchService Switched selector for service 'alb-rollout-canary' from '' to 'd6f4fdcdc'
2023-11-01T00:33:19Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (5c88b985b6)
2023-11-01T00:33:19Z Normal RolloutUpdated Rollout updated to revision 2
2023-11-01T00:33:19Z Normal NewReplicaSetCreated Created ReplicaSet alb-rollout-5c88b985b6 (revision 2)
2023-11-01T00:33:19Z (x2) Normal TrafficWeightUpdated Traffic weight updated
2023-11-01T00:33:19Z Normal ExperimentCreated Created Experiment 'alb-rollout-5c88b985b6-2-0'
2023-11-01T00:33:20Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-multi-ingress-1` to desiredWeight '0'
2023-11-01T00:33:20Z (x2) Normal PatchingALBIngress Updating Ingress `alb-rollout-multi-ingress-2` to desiredWeight '0'
2023-11-01T00:33:20Z Normal TrafficWeightUpdated Traffic weight updated additional: [{20 } {20 }]
time="2023-11-01T00:33:30Z" level=info msg="Deleting e2e-test-name=TestALBExperimentStepNoSetWeightMultiIngress"
--- FAIL: TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress (14.13s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
6 out of 10 runs failed: TestCanarySuite/TestCanaryDynamicStableScale (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 19s]
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 19s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 19s]
Raw output
Failed
=== RUN TestCanarySuite/TestCanaryDynamicStableScale
time="2023-11-01T00:34:03Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
W1101 00:34:03.471646 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1101 00:34:03.474274 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-11-01T00:34:03Z" level=info msg="service/dynamic-stable-scale-root created\n" rollout=dynamic-stable-scale
time="2023-11-01T00:34:04Z" level=info msg="service/dynamic-stable-scale-canary created\n" rollout=dynamic-stable-scale
time="2023-11-01T00:34:04Z" level=info msg="service/dynamic-stable-scale-stable created\n" rollout=dynamic-stable-scale
time="2023-11-01T00:34:04Z" level=info msg="ingress.networking.k8s.io/dynamic-stable-scale-ingress created\n" rollout=dynamic-stable-scale
time="2023-11-01T00:34:04Z" level=info msg="rollout.argoproj.io/dynamic-stable-scale created\n" rollout=dynamic-stable-scale
time="2023-11-01T00:34:05Z" level=info msg="Marked 4 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-11-01T00:34:05Z" level=info msg="Waiting for condition: status=Healthy" rollout=dynamic-stable-scale
time="2023-11-01T00:34:09Z" level=info msg="Condition 'status=Healthy' met after 3s" rollout=dynamic-stable-scale
time="2023-11-01T00:34:09Z" level=info msg="Updated rollout pod spec: 2023-11-01T00:34:09.579901551Z" rollout=dynamic-stable-scale
time="2023-11-01T00:34:10Z" level=info msg="Marked 1 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-11-01T00:34:10Z" level=info msg="Waiting for condition: status=Paused" rollout=dynamic-stable-scale
time="2023-11-01T00:34:10Z" level=info msg="Condition 'status=Paused' met after 0s" rollout=dynamic-stable-scale
time="2023-11-01T00:34:10Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-11-01T00:34:12Z" level=info msg="Pod expectation 'revision:1 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-11-01T00:34:12Z" level=info msg="Pod expectation 'revision:2 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-11-01T00:34:12Z" level=info msg="Promoted rollout" rollout=dynamic-stable-scale
time="2023-11-01T00:34:14Z" level=info msg="Marked 2 revision 2 pods as ready" rollout=dynamic-stable-scale
time="2023-11-01T00:34:14Z" level=info msg="Waiting for condition: status.currentStepIndex=3" rollout=dynamic-stable-scale
time="2023-11-01T00:34:15Z" level=info msg="Condition 'status.currentStepIndex=3' met after 1s" rollout=dynamic-stable-scale
time="2023-11-01T00:34:15Z" level=info msg="Sleeping 2s" rollout=dynamic-stable-scale
time="2023-11-01T00:34:17Z" level=info msg="Pod expectation 'revision:1 pod count == 1' met" rollout=dynamic-stable-scale
time="2023-11-01T00:34:17Z" level=info msg="Pod expectation 'revision:2 pod count == 3' met" rollout=dynamic-stable-scale
time="2023-11-01T00:34:17Z" level=info msg="Aborted rollout" rollout=dynamic-stable-scale
time="2023-11-01T00:34:18Z" level=info msg="Marked 2 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-11-01T00:34:18Z" level=info msg="Waiting for condition: rev=2 podcount=1" rollout=dynamic-stable-scale
time="2023-11-01T00:34:21Z" level=info msg="Condition 'rev=2 podcount=1' met after 2s" rollout=dynamic-stable-scale
time="2023-11-01T00:34:21Z" level=info msg="Pod expectation 'revision:1 pod count == 4' met" rollout=dynamic-stable-scale
time="2023-11-01T00:34:22Z" level=info msg="Marked 1 revision 1 pods as ready" rollout=dynamic-stable-scale
time="2023-11-01T00:34:22Z" level=info msg="Waiting for condition: rev=2 podcount=0" rollout=dynamic-stable-scale
time="2023-11-01T00:34:22Z" level=info msg="Condition 'rev=2 podcount=0' met after 0s" rollout=dynamic-stable-scale
canary_test.go:621: Expected dynamic-stable-scale-canary selector: map[app:dynamic-stable-scale rollouts-pod-template-hash:868d98995b]. Actual: map[app:dynamic-stable-scale rollouts-pod-template-hash:5f5bdc689f]
Name: dynamic-stable-scale
Namespace: default
Status: �[31m✖�[0m Degraded
Message: RolloutAborted: Rollout aborted update to revision 2
Strategy: Canary
Step: 0/4
SetWeight: 0
ActualWeight: 0
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 4
Current: 4
Updated: 0
Ready: 4
Available: 4
NAME KIND STATUS AGE INFO
⟳ dynamic-stable-scale Rollout �[31m✖�[0m Degraded 18s
├──# revision:2
│ └──⧉ �[33mdynamic-stable-scale-5f5bdc689f�[0m ReplicaSet �[0m•�[0m ScaledDown 13s �[33mcanary�[0m
│ ├──□ dynamic-stable-scale-5f5bdc689f-9lrzl Pod �[94m◌�[0m Terminating 13s ready:1/1
│ └──□ dynamic-stable-scale-5f5bdc689f-wn9sv Pod �[94m◌�[0m Terminating 9s ready:1/1
└──# revision:1
└──⧉ �[32mdynamic-stable-scale-868d98995b�[0m ReplicaSet �[32m✔�[0m Healthy 18s �[32mstable�[0m
├──□ dynamic-stable-scale-868d98995b-4ln98 Pod �[32m✔�[0m Running 18s ready:1/1
├──□ dynamic-stable-scale-868d98995b-9bgk6 Pod �[32m✔�[0m Running 5s ready:1/1
├──□ dynamic-stable-scale-868d98995b-qj5vd Pod �[32m✔�[0m Running 4s ready:1/1
└──□ dynamic-stable-scale-868d98995b-z4r6d Pod �[32m✔�[0m Running 4s ready:1/1
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "2"
creationTimestamp: "2023-11-01T00:34:04Z"
generation: 2
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryDynamicStableScale
name: dynamic-stable-scale
namespace: default
resourceVersion: "6513"
uid: 5adbe354-4fe3-4484-b793-ed04c72240c3
spec:
replicas: 4
selector:
matchLabels:
app: dynamic-stable-scale
strategy:
canary:
canaryService: dynamic-stable-scale-canary
dynamicStableScale: true
stableService: dynamic-stable-scale-stable
steps:
- setWeight: 25
- pause: {}
- setWeight: 75
- pause: {}
trafficRouting:
alb:
ingress: dynamic-stable-scale-ingress
rootService: dynamic-stable-scale-root
servicePort: 80
template:
metadata:
annotations:
update: "2023-11-01T00:34:09.579901551Z"
creationTimestamp: null
labels:
app: dynamic-stable-scale
spec:
containers:
- image: nginx:1.19-alpine
name: dynamic-stable-scale
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
readinessGates:
- conditionType: argoproj.io/e2e-readiness
status:
HPAReplicas: 4
abort: true
abortedAt: "2023-11-01T00:34:17Z"
availableReplicas: 4
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 5f5bdc689f
serviceName: dynamic-stable-scale-canary
weight: 0
stable:
podTemplateHash: 868d98995b
serviceName: dynamic-stable-scale-stable
weight: 100
conditions:
- lastTransitionTime: "2023-11-01T00:34:09Z"
lastUpdateTime: "2023-11-01T00:34:09Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-11-01T00:34:09Z"
lastUpdateTime: "2023-11-01T00:34:09Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-11-01T00:34:09Z"
lastUpdateTime: "2023-11-01T00:34:09Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "False"
type: Completed
- lastTransitionTime: "2023-11-01T00:34:15Z"
lastUpdateTime: "2023-11-01T00:34:15Z"
message: Rollout is paused
reason: RolloutPaused
status: "True"
type: Paused
- lastTransitionTime: "2023-11-01T00:34:17Z"
lastUpdateTime: "2023-11-01T00:34:17Z"
message: Rollout aborted update to revision 2
reason: RolloutAborted
status: "False"
type: Progressing
currentPodHash: 5f5bdc689f
currentStepHash: 7c5b668566
currentStepIndex: 0
message: 'RolloutAborted: Rollout aborted update to revision 2'
observedGeneration: "2"
phase: Degraded
readyReplicas: 4
replicas: 4
selector: app=dynamic-stable-scale
stableRS: 868d98995b
2023-11-01T00:34:04Z Normal RolloutAddedToInformer Rollout resource added to informer: default/dynamic-stable-scale
2023-11-01T00:34:04Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (868d98995b)
2023-11-01T00:34:04Z Normal RolloutUpdated Rollout updated to revision 1
2023-11-01T00:34:04Z Normal NewReplicaSetCreated Created ReplicaSet dynamic-stable-scale-868d98995b (revision 1)
2023-11-01T00:34:04Z Normal PatchingALBIngress Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '0'
2023-11-01T00:34:04Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-11-01T00:34:04Z Normal ScalingReplicaSet Scaled up ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 0 to 4
2023-11-01T00:34:04Z Normal RolloutCompleted Rollout completed update to revision 1 (868d98995b): Initial deploy
2023-11-01T00:34:09Z Normal SwitchService Switched selector for service 'dynamic-stable-scale-stable' from '' to '868d98995b'
2023-11-01T00:34:09Z Normal SwitchService Switched selector for service 'dynamic-stable-scale-canary' from '' to '868d98995b'
2023-11-01T00:34:09Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (5f5bdc689f)
2023-11-01T00:34:09Z Normal RolloutUpdated Rollout updated to revision 2
2023-11-01T00:34:09Z Normal NewReplicaSetCreated Created ReplicaSet dynamic-stable-scale-5f5bdc689f (revision 2)
2023-11-01T00:34:09Z (x3) Normal TrafficWeightUpdated Traffic weight updated
2023-11-01T00:34:09Z Normal ScalingReplicaSet Scaled up ReplicaSet dynamic-stable-scale-5f5bdc689f (revision 2) from 0 to 1
2023-11-01T00:34:10Z Normal SwitchService Switched selector for service 'dynamic-stable-scale-canary' from '868d98995b' to '5f5bdc689f'
2023-11-01T00:34:10Z Normal PatchingALBIngress Updating Ingress `dynamic-stable-scale-ingress` to desiredWeight '25'
2023-11-01T00:34:10Z Normal TrafficWeightUpdated Traffic weight updated from 0 to 25
2023-11-01T00:34:10Z Normal RolloutStepCompleted Rollout step 1/4 completed (setWeight: 25)
2023-11-01T00:34:10Z Normal ScalingReplicaSet Scaled down ReplicaSet dynamic-stable-scale-868d98995b (revision 1) from 4 to 3
2023-11-01T00:34:10Z Normal RolloutPaused Rollout is paused (CanaryPauseStep)
2023-11-01T00:34:12Z Normal RolloutStepCompleted Rollout step 2/4 completed (pause)
time="2023-11-01T00:34:22Z" level=info msg="Deleting e2e-test-name=TestCanaryDynamicStableScale"
W1101 00:34:22.803322 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1101 00:34:22.806581 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestCanarySuite/TestCanaryDynamicStableScale (19.43s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
1 out of 5 runs failed: TestCanarySuite/TestCanaryScaleDownDelay (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 10s]
Raw output
Failed
=== RUN TestCanarySuite/TestCanaryScaleDownDelay
time="2023-11-01T00:36:42Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownDelay"
W1101 00:36:42.926188 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1101 00:36:42.929868 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
time="2023-11-01T00:36:43Z" level=info msg="service/canary-scaledowndelay-root created\n" rollout=canary-scaledowndelay
time="2023-11-01T00:36:43Z" level=info msg="service/canary-scaledowndelay-canary created\n" rollout=canary-scaledowndelay
time="2023-11-01T00:36:43Z" level=info msg="service/canary-scaledowndelay-stable created\n" rollout=canary-scaledowndelay
time="2023-11-01T00:36:44Z" level=info msg="ingress.networking.k8s.io/canary-scaledowndelay-ingress created\n" rollout=canary-scaledowndelay
time="2023-11-01T00:36:44Z" level=info msg="rollout.argoproj.io/canary-scaledowndelay created\n" rollout=canary-scaledowndelay
time="2023-11-01T00:36:44Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-11-01T00:36:46Z" level=info msg="Condition 'status=Healthy' met after 1s" rollout=canary-scaledowndelay
time="2023-11-01T00:36:46Z" level=info msg="Updated rollout spec: {\"spec\":{\"template\":{\"metadata\":{\"annotations\":{\"rev\":\"two\"}}}}}" rollout=canary-scaledowndelay
time="2023-11-01T00:36:46Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-11-01T00:36:47Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledowndelay
time="2023-11-01T00:36:47Z" level=info msg="Sleeping 2s" rollout=canary-scaledowndelay
time="2023-11-01T00:36:49Z" level=info msg="Updated rollout spec: {\"spec\":{\"template\":{\"metadata\":{\"annotations\":{\"rev\":\"three\"}}}}}" rollout=canary-scaledowndelay
time="2023-11-01T00:36:49Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-11-01T00:36:50Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledowndelay
time="2023-11-01T00:36:51Z" level=info msg="Updated rollout spec: {\"spec\":{\"template\":{\"metadata\":{\"annotations\":{\"rev\":\"two\"}}}}}" rollout=canary-scaledowndelay
time="2023-11-01T00:36:51Z" level=info msg="Waiting for condition: status=Healthy" rollout=canary-scaledowndelay
time="2023-11-01T00:36:51Z" level=info msg="Condition 'status=Healthy' met after 0s" rollout=canary-scaledowndelay
canary_test.go:529:
Error Trace: /home/runner/work/argo-rollouts/argo-rollouts/test/e2e/canary_test.go:529
/home/runner/work/argo-rollouts/argo-rollouts/test/fixtures/then.go:28
/home/runner/work/argo-rollouts/argo-rollouts/test/e2e/canary_test.go:517
Error: Should NOT be empty, but was
Test: TestCanarySuite/TestCanaryScaleDownDelay
Name: canary-scaledowndelay
Namespace: default
Status: �[32m✔�[0m Healthy
Strategy: Canary
Step:
SetWeight: 100
ActualWeight: 100
Images: nginx:1.19-alpine (�[32mstable�[0m)
Replicas:
Desired: 1
Current: 2
Updated: 1
Ready: 2
Available: 2
NAME KIND STATUS AGE INFO
⟳ canary-scaledowndelay Rollout �[32m✔�[0m Healthy 8s
├──# revision:4
│ └──⧉ �[32mcanary-scaledowndelay-7c74c66d54�[0m ReplicaSet �[32m✔�[0m Healthy 6s �[32mstable�[0m
│ └──□ canary-scaledowndelay-7c74c66d54-xkgrk Pod �[32m✔�[0m Running 6s ready:1/1
├──# revision:3
│ └──⧉ canary-scaledowndelay-9586cf7d4 ReplicaSet �[32m✔�[0m Healthy 3s
│ └──□ canary-scaledowndelay-9586cf7d4-qhhrh Pod �[32m✔�[0m Running 3s ready:1/1
└──# revision:1
└──⧉ canary-scaledowndelay-66597877b7 ReplicaSet �[0m•�[0m ScaledDown 8s
---
apiVersion: argoproj.io/v1alpha1
kind: Rollout
metadata:
annotations:
rollout.argoproj.io/revision: "4"
creationTimestamp: "2023-11-01T00:36:44Z"
generation: 5
labels:
argo-rollouts.argoproj.io/controller-instance-id: argo-rollouts-e2e
e2e-test-name: TestCanaryScaleDownDelay
name: canary-scaledowndelay
namespace: default
resourceVersion: "7335"
uid: e7c38a22-6369-42c6-93ca-76fccc698a25
spec:
replicas: 1
selector:
matchLabels:
app: canary-scaledowndelay
strategy:
canary:
canaryService: canary-scaledowndelay-canary
scaleDownDelayRevisionLimit: 1
stableService: canary-scaledowndelay-stable
trafficRouting:
alb:
ingress: canary-scaledowndelay-ingress
rootService: canary-scaledowndelay-root
servicePort: 80
template:
metadata:
annotations:
rev: two
creationTimestamp: null
labels:
app: canary-scaledowndelay
spec:
containers:
- image: nginx:1.19-alpine
name: canary-scaledowndelay
ports:
- containerPort: 80
name: http
protocol: TCP
resources:
requests:
cpu: 5m
memory: 16Mi
status:
HPAReplicas: 2
availableReplicas: 2
blueGreen: {}
canary:
weights:
canary:
podTemplateHash: 7c74c66d54
serviceName: canary-scaledowndelay-canary
weight: 0
stable:
podTemplateHash: 9586cf7d4
serviceName: canary-scaledowndelay-stable
weight: 100
conditions:
- lastTransitionTime: "2023-11-01T00:36:46Z"
lastUpdateTime: "2023-11-01T00:36:46Z"
message: Rollout has minimum availability
reason: AvailableReason
status: "True"
type: Available
- lastTransitionTime: "2023-11-01T00:36:46Z"
lastUpdateTime: "2023-11-01T00:36:46Z"
message: Rollout is not healthy
reason: RolloutHealthy
status: "False"
type: Healthy
- lastTransitionTime: "2023-11-01T00:36:44Z"
lastUpdateTime: "2023-11-01T00:36:51Z"
message: ReplicaSet "canary-scaledowndelay-7c74c66d54" is progressing.
reason: ReplicaSetUpdated
status: "True"
type: Progressing
- lastTransitionTime: "2023-11-01T00:36:51Z"
lastUpdateTime: "2023-11-01T00:36:51Z"
message: RolloutCompleted
reason: RolloutCompleted
status: "True"
type: Completed
currentPodHash: 7c74c66d54
currentStepHash: 5ffbfbbd64
observedGeneration: "5"
phase: Healthy
readyReplicas: 2
replicas: 2
selector: app=canary-scaledowndelay
stableRS: 7c74c66d54
updatedReplicas: 1
2023-11-01T00:36:44Z Normal RolloutAddedToInformer Rollout resource added to informer: default/canary-scaledowndelay
2023-11-01T00:36:44Z Normal RolloutNotCompleted Rollout not completed, started update to revision 1 (66597877b7)
2023-11-01T00:36:44Z Normal RolloutUpdated Rollout updated to revision 1
2023-11-01T00:36:44Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledowndelay-66597877b7 (revision 1)
2023-11-01T00:36:44Z Normal PatchingALBIngress Updating Ingress `canary-scaledowndelay-ingress` to desiredWeight '0'
2023-11-01T00:36:44Z (x2) Normal TrafficWeightUpdated Traffic weight updated to 0
2023-11-01T00:36:44Z Normal ScalingReplicaSet Scaled up ReplicaSet canary-scaledowndelay-66597877b7 (revision 1) from 0 to 1
2023-11-01T00:36:44Z Normal RolloutCompleted Rollout completed update to revision 1 (66597877b7): Initial deploy
2023-11-01T00:36:46Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-stable' from '' to '66597877b7'
2023-11-01T00:36:46Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '' to '66597877b7'
2023-11-01T00:36:46Z Normal RolloutNotCompleted Rollout not completed, started update to revision 2 (7c74c66d54)
2023-11-01T00:36:46Z Normal RolloutUpdated Rollout updated to revision 2
2023-11-01T00:36:46Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledowndelay-7c74c66d54 (revision 2)
2023-11-01T00:36:46Z Normal ScalingReplicaSet Scaled up ReplicaSet canary-scaledowndelay-7c74c66d54 (revision 2) from 0 to 1
2023-11-01T00:36:47Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-canary' from '66597877b7' to '7c74c66d54'
2023-11-01T00:36:47Z Normal RolloutCompleted Rollout completed update to revision 2 (7c74c66d54): Completed all 0 canary steps
2023-11-01T00:36:47Z Normal SwitchService Switched selector for service 'canary-scaledowndelay-stable' from '66597877b7' to '7c74c66d54'
2023-11-01T00:36:47Z (x4) Normal TrafficWeightUpdated Traffic weight updated
2023-11-01T00:36:49Z Normal RolloutNotCompleted Rollout not completed, started update to revision 3 (9586cf7d4)
2023-11-01T00:36:49Z Normal RolloutUpdated Rollout updated to revision 3
2023-11-01T00:36:49Z Normal NewReplicaSetCreated Created ReplicaSet canary-scaledowndelay-9586cf7d4 (revision 3)
time="2023-11-01T00:36:52Z" level=info msg="Deleting e2e-test-name=TestCanaryScaleDownDelay"
W1101 00:36:52.819532 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
W1101 00:36:52.822962 20336 warnings.go:70] policy/v1beta1 PodDisruptionBudget is deprecated in v1.21+, unavailable in v1.25+; use policy/v1 PodDisruptionBudget
--- FAIL: TestCanarySuite/TestCanaryScaleDownDelay (10.00s)
Check warning on line 0 in github.com/argoproj/argo-rollouts/test/e2e
github-actions / E2E Tests Published Test Results
6 out of 11 runs failed: TestCanarySuite (github.com/argoproj/argo-rollouts/test/e2e)
artifacts/E2E Test Results (k8s 1.23)/junit.xml [took 4m 22s]
artifacts/E2E Test Results (k8s 1.24)/junit.xml [took 19s]
artifacts/E2E Test Results (k8s 1.26)/junit.xml [took 19s]
Raw output
Failed
=== RUN TestCanarySuite
time="2023-11-01T00:34:03Z" level=info msg="analysistemplate.argoproj.io/sleep-job created\n"
--- FAIL: TestCanarySuite (262.73s)
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
6 skipped tests found
There are 6 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite
Check notice on line 0 in .github
github-actions / E2E Tests Published Test Results
103 tests found
There are 103 tests, see "Raw output" for the full list of tests.
Raw output
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanarySetHeaderStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAPISIXSuite/TestAPISIXCanaryStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBCanaryUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeight
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBExperimentStepNoSetWeightMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestALBPingPongUpdateMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAWSSuite/TestAlbHeaderRouteMultiIngress
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestAnalysisWithSecret
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBackgroundAnalysisWithArgs
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAbortAndUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenKitchenSink
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPostPromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestBlueGreenPrePromotionFail
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryBackgroundAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryFailInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestCanaryInlineMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAnalysisSuite/TestMultipleAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestAppMeshSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenPreviewReplicaCount
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestBlueGreenProgressDeadlineExceededWithoutPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestBlueGreenSuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryDynamicStableScaleRollbackToStable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryProgressDeadlineExceededWithPause
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryScaleDownOnAbortNoTrafficRouting
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanarySetCanaryScale
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestCanaryUnScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestEphemeralMetadata
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestReduceWeightAndHonorMaxUnavailable
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutScalingWhenPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestCanarySuite/TestRolloutWithMaxSurgeScalingDuringUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithDryRunMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMeasurementRetentionMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithMultiportServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestExperimentWithServiceNameAndScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestExperimentSuite/TestRolloutWithExperimentAndAnalysis
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenExceedProgressDeadlineAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPreviewReplicaCountPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownDelay
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenScaleDownOnAbort
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenToCanary
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestBlueGreenUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCanaryPromoteFull
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestCompleteRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestContainerResourceFormats
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestControllerMetrics
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestFixInvalidSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForCompleted
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestKubectlWaitForPaused
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRollout
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestMalformedRolloutEphemeralCtr
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutAbortRetryPromote
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodSetWeightUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutBadToGoodUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutGoodToBadUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPDBRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPauseDurationGreaterThanProgressDeadlineSeconds
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutPodVolumesItemsSpec
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestRolloutRestart
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRef
github.com/argoproj/argo-rollouts/test/e2e ‑ TestFunctionalSuite/TestWorkloadRefTemplate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestHeaderRoutingSuite/TestIstioHostHeaderRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdate
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioAbortUpdateDeleteAllCanaryPods
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioHostSplitOnlyTls
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplit
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitExperimentStep
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioSubsetSplitSingleRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestIstioSuite/TestIstioUpdateInMiddleZeroCanaryReplicas
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestMirrorRouteSuite/TestIstioHostMirrorRoute
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisOutsideWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestRollbackSuite/TestRollbackAnalysisWithinWindow
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMIIngressSuite
github.com/argoproj/argo-rollouts/test/e2e ‑ TestSMISuite