[root@master-1-vxa4Qh4cj2ZFH e2e]# ./run-e2e-test.sh --pmax --minimal /root/surya/pmax-e2e/csm-operator/tests/e2e W1017 18:38:44.454455 3260309 test_context.go:538] Unable to find in-cluster config, using default host : https://127.0.0.1:6443 I1017 18:38:44.454616 3260309 test_context.go:561] The --provider flag is not set. Continuing as if --provider=skeleton had been used. Running Suite: CSM Operator End-to-End Tests - /root/surya/pmax-e2e/csm-operator/tests/e2e ========================================================================================== Random Seed: 1729190122 Will run 1 of 1 specs ------------------------------ [BeforeSuite] /root/surya/pmax-e2e/csm-operator/tests/e2e/e2e_test.go:99 STEP: Getting test environment variables @ 10/17/24 18:38:44.455 STEP: [powermax] @ 10/17/24 18:38:44.455 STEP: Reading values file @ 10/17/24 18:38:44.455 STEP: Getting a k8s client @ 10/17/24 18:38:44.457 [BeforeSuite] PASSED [0.006 seconds] ------------------------------ [run-e2e-test] E2E Testing Running all test Given Test Scenarios /root/surya/pmax-e2e/csm-operator/tests/e2e/e2e_test.go:140 STEP: Starting: Install PowerMax Driver(Standalone) @ 10/17/24 18:38:44.46 STEP: Returning false here @ 10/17/24 18:38:44.46 STEP: Executing Given an environment with k8s or openshift, and CSM operator installed @ 10/17/24 18:38:44.46 STEP: Executing Create storageclass with name [op-e2e-pmax] and template [testfiles/powermax-templates/powermax-storageclass-template.yaml] for [pmax] @ 10/17/24 18:38:44.471 STEP: Executing Set up creds with template [testfiles/powermax-templates/powermax-secret-template.yaml] for [pmaxCreds] @ 10/17/24 18:38:44.769 STEP: Executing Set up configMap with template [testfiles/powermax-templates/powermax_reverse_proxy_config.yaml] name [powermax-reverseproxy-config] in namespace [powermax] for [pmaxAuthSidecar] @ 10/17/24 18:38:45.046 STEP: Executing Apply custom resource [1] @ 10/17/24 18:38:45.304 I1017 18:38:45.304962 3260309 builder.go:121] Running '/usr/bin/kubectl --namespace=powermax apply --validate=true -f -' I1017 18:38:45.406474 3260309 builder.go:146] stderr: "" I1017 18:38:45.406579 3260309 builder.go:147] stdout: "containerstoragemodule.storage.dell.com/powermax created\n" STEP: Executing Validate custom resource [1] @ 10/17/24 18:38:45.406 err: expected custom resource status to be Succeeded. Got: Failed STEP: Executing Validate [powermax] driver from CR [1] is installed @ 10/17/24 18:39:35.447 err: The container(registrar) in pod(powermax-node-fczzw) is {nil nil &ContainerStateTerminated{ExitCode:1,Signal:0,Reason:Error,Message:,StartedAt:2024-10-17 18:39:18 +0000 UTC,FinishedAt:2024-10-17 18:39:48 +0000 UTC,ContainerID:containerd://28d3e864e78a02f7288b76a4fb45d69ca7a6d4b3da90d17bf27736bc753eb03e,}} The container(registrar) in pod(powermax-node-lx5l2) is {nil nil &ContainerStateTerminated{ExitCode:1,Signal:0,Reason:Error,Message:,StartedAt:2024-10-17 18:39:17 +0000 UTC,FinishedAt:2024-10-17 18:39:47 +0000 UTC,ContainerID:containerd://3d83c66a9630570ce436611fefa0cff0c075a61426ead033a5ccfc5d15ec3155,}} STEP: Executing Run custom test @ 10/17/24 18:40:25.493 I1017 18:40:25.493211 3260309 util.go:650] Running cert-csi [test vio --sc op-e2e-pmax --chainLength 1 --chainNumber 1] [2024-10-17 18:40:25] INFO Starting cert-csi; ver. 1.4.0 [2024-10-17 18:40:25] INFO Using EVENT observer type [2024-10-17 18:40:25] INFO Using config from /root/.kube/config [2024-10-17 18:40:25] INFO Successfully loaded config. Host: https://10.247.22.239:6443 [2024-10-17 18:40:25] INFO Created new KubeClient [2024-10-17 18:40:25] INFO Running 1 iteration(s) [2024-10-17 18:40:25] INFO *** ITERATION NUMBER 1 *** [2024-10-17 18:40:25] INFO Starting VolumeIoSuite with op-e2e-pmax storage class [2024-10-17 18:40:25] INFO Successfully created namespace volumeio-test-0f8c4691 [2024-10-17 18:40:25] INFO Using default number of volumes [2024-10-17 18:40:25] INFO Using default image: docker.io/centos:latest [2024-10-17 18:40:25] INFO Creating IO pod [2024-10-17 18:40:25] INFO Waiting for pod iowriter-test-ccb76 to be READY [2024-10-17 18:41:07] INFO Executing command: [/bin/bash -c dd if=/dev/urandom bs=1M count=128 oflag=sync > /data0/writer-0.data] [2024-10-17 18:41:08] INFO Executing command: [/bin/bash -c sha512sum /data0/writer-0.data > /data0/writer-0.sha512] [2024-10-17 18:41:16] INFO Waiting until no Volume Attachments with PV left [2024-10-17 18:41:16] INFO VolumeAttachment deleted [2024-10-17 18:41:16] INFO Deleting all resources in namespace volumeio-test-0f8c4691 [2024-10-17 18:41:28] INFO Namespace volumeio-test-0f8c4691 was deleted in 12.013344796s [2024-10-17 18:41:28] INFO Waiting for volumeattachments to be deleted [2024-10-17 18:41:31] INFO SUCCESS: VolumeIoSuite in 1m5.500161858s [2024-10-17 18:41:31] INFO Started generating reports... Collecting metrics 1 / 1 [-----------------------------------------------------------------------------------------------------------------------------------------------------------------------] 100.00% ? p/s[2024-10-17 18:41:31] INFO Started generating reports... Collecting metrics Generating plots 1 / 1 [-----------------------------------------------------------------------------------------------------------------------------------------------------------------------] 100.00% ? p/s1 / 1 [---------------------------------------------------------------------------------------------------------------------------------------------------------------------->] 100.00% ? p/s1 / 1 [---------------------------------------------------------------------------------------------------------------------------------------------------------------------] 100.00% 120 p/s[2024-10-17 18:41:31] WARN No ResourceUsageMetrics provided [2024-10-17 18:41:31] ERROR no ResourceUsageMetrics provided report-test-run-b8728d8a: Name: test-run-b8728d8a Host: https://10.247.22.239:6443 StorageClass: op-e2e-pmax Minimum and Maximum EntityOverTime charts: /root/.cert-csi/reports/test-run-b8728d8a/PodsCreatingOverTime.png /root/.cert-csi/reports/test-run-b8728d8a/PodsReadyOverTime.png /root/.cert-csi/reports/test-run-b8728d8a/PodsTerminatingOverTime.png /root/.cert-csi/reports/test-run-b8728d8a/PvcsCreatingOverTime.png /root/.cert-csi/reports/test-run-b8728d8a/PvcsBoundOverTime.png Tests: -------------------------------------------------------------- 1. TestCase: VolumeIoSuite Started: 2024-10-17 18:40:25.618017824 +0000 UTC Ended: 2024-10-17 18:41:31.117916736 +0000 UTC Result: SUCCESS Stage metrics: PVCAttachment: Avg: 18.322224994s Min: 18.322224994s Max: 18.322224994s Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCAttachment.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCAttachment_boxplot.png PVCBind: Avg: 8.875083181s Min: 8.875083181s Max: 8.875083181s Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCBind.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCBind_boxplot.png PVCCreation: Avg: 27.446408706s Min: 27.446408706s Max: 27.446408706s Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCCreation.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCCreation_boxplot.png PVCDeletion: Avg: 15.905045ms Min: 15.905045ms Max: 15.905045ms Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCDeletion.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCDeletion_boxplot.png PVCUnattachment: Avg: 2.370958612s Min: 2.370958612s Max: 2.370958612s Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCUnattachment.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PVCUnattachment_boxplot.png PodCreation: Avg: 41.093988018s Min: 41.093988018s Max: 41.093988018s Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PodCreation.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PodCreation_boxplot.png PodDeletion: Avg: 6.731623917s Min: 6.731623917s Max: 6.731623917s Histogram: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PodDeletion.png BoxPlot: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/PodDeletion_boxplot.png EntityNumberOverTime: /root/.cert-csi/reports/test-run-b8728d8a/VolumeIoSuite1/EntityNumberOverTime.png [2024-10-17 18:41:31] INFO Avg time of a run: 51.22s [2024-10-17 18:41:31] INFO Avg time of a del: 12.01s [2024-10-17 18:41:31] INFO Avg time of all: 65.50s [2024-10-17 18:41:31] INFO During this run 100.0% of suites succeeded STEP: Executing Enable forceRemoveDriver on CR [1] @ 10/17/24 18:41:31.624 STEP: Executing Delete custom resource [1] @ 10/17/24 18:41:31.69 STEP: Executing Restore template [testfiles/powermax-templates/powermax_reverse_proxy_config.yaml] for [pmaxAuthSidecar] @ 10/17/24 18:41:31.727 STEP: Executing Restore template [testfiles/powermax-templates/powermax-storageclass-template.yaml] for [pmax] @ 10/17/24 18:41:31.767 STEP: Executing Restore template [testfiles/powermax-templates/powermax-secret-template.yaml] for [pmaxCreds] @ 10/17/24 18:41:31.809 STEP: Ending: Install PowerMax Driver(Standalone) @ 10/17/24 18:41:31.834 • [172.375 seconds] ------------------------------ Ran 1 of 1 Specs in 172.381 seconds SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped PASS Ginkgo ran 1 suite in 6m14.38521508s Test Suite Passed