Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate message experiment #278

Merged
merged 4 commits into from
Dec 8, 2022
Merged

Migrate message experiment #278

merged 4 commits into from
Dec 8, 2022

Conversation

ChrisKujawa
Copy link
Member

related to #237

Similar to the other migrated experiments I followed same approach as described here #268

The experiment was executed and verified via the integration test against a self-managed cluster.

I moved the experiment into the chaos-experiments/camunda-cloud/test/ folder and migrated it, with that approach I was able to execute the experiment with eze and running against my self-managed zell-chaos zeebe cluster.

Log output:

Create ChaosToolkit instance
Open workers: [zbchaos, readExperiments].
Handle read experiments job [key: 2251799813685265]
Read experiments successful, complete job with: {"experiments":[{"contributions":{"availability":"high","reliability":"high"},"description":"This fake experiment is just to test the integration with Zeebe and zbchaos workers","method":[{"name":"Show again the version","provider":{"arguments":["version"],"path":"zbchaos","timeout":900,"type":"process"},"tolerance":0,"type":"action"}],"rollbacks":[],"steady-state-hypothesis":{"probes":[{"name":"Show version","provider":{"arguments":["version"],"path":"zbchaos","timeout":900,"type":"process"},"tolerance":0,"type":"probe"}],"title":"Zeebe is alive"},"title":"This is a fake experiment","version":"0.1.0"},{"contributions":{"availability":"high","reliability":"high"},"description":"Zeebe message correlation should work even if the leader was restarted on which the message was published.","method":[{"name":"Deploy process model with catch event","provider":{"arguments":["deploy","process","--processModelPath","bpmn/msg-catch.bpmn"],"path":"zbchaos","type":"process"},"tolerance":0,"type":"action"},{"name":"Publish message to partition one","provider":{"arguments":["publish","--partitionId","1"],"path":"zbchaos","type":"process"},"tolerance":0,"type":"action"},{"name":"Terminate leader of partition 1 non-gracefully","provider":{"arguments":["terminate","broker","--role","LEADER","--partitionId","1"],"path":"zbchaos","type":"process"},"type":"action"},{"name":"All pods should be ready","provider":{"arguments":["verify","readiness"],"path":"zbchaos","timeout":900,"type":"process"},"tolerance":0,"type":"probe"},{"name":"Should be able to create a process instance and await the message correlation","provider":{"arguments":["verify","instance-creation","--awaitResult","--bpmnProcessId","oneReceiveMsgEvent","--variables","{\"key\": \"0\"}"],"path":"zbchaos","type":"process"},"tolerance":0,"type":"probe"}],"rollbacks":[],"steady-state-hypothesis":{"probes":[{"name":"All pods should be ready","provider":{"arguments":["verify","readiness"],"path":"zbchaos","timeout":900,"type":"process"},"tolerance":0,"type":"probe"}],"title":"Zeebe is alive"},"title":"Zeebe message correlation experiment","version":"0.1.0"}]}.
Handle zbchaos job [key: 2251799813685328]
Running command with args: [version] 
zbchaos development (commit: HEAD)
Handle zbchaos job [key: 2251799813685374]
Running command with args: [version] 
zbchaos development (commit: HEAD)
Handle zbchaos job [key: 2251799813685417]
Running command with args: [version] 
zbchaos development (commit: HEAD)
Handle zbchaos job [key: 2251799813685508]
Running command with args: [verify readiness] 
Connecting to zell-chaos
Running experiment in self-managed environment.
All Zeebe nodes are running.
Handle zbchaos job [key: 2251799813685553]
Running command with args: [deploy process --processModelPath bpmn/msg-catch.bpmn] 
Connecting to zell-chaos
Running experiment in self-managed environment.
Successfully created port forwarding tunnel
Deploy file bpmn/msg-catch.bpmn (size: 2986 bytes).
Deployed process model bpmn/msg-catch.bpmn successful with key 2251799813685249.
Deployed given process model bpmn/msg-catch.bpmn, under key 2251799813685249!
Handle zbchaos job [key: 2251799813685609]
Running command with args: [publish --partitionId 1] 
Connecting to zell-chaos
Running experiment in self-managed environment.
Successfully created port forwarding tunnel
Send message 'msg', with correaltion key '0' (ASCII: 48) 
Message was sent and returned key 2251799813685251, which corresponds to partition: 1
Handle zbchaos job [key: 2251799813685652]
Running command with args: [terminate broker --role LEADER --partitionId 1] 
Connecting to zell-chaos
Running experiment in self-managed environment.
Successfully created port forwarding tunnel
Found Broker zell-chaos-zeebe-0 as LEADER for partition 1.
Terminated zell-chaos-zeebe-0
Handle zbchaos job [key: 2251799813685696]
Running command with args: [verify readiness] 
Connecting to zell-chaos
Running experiment in self-managed environment.
Pod zell-chaos-zeebe-0 is in phase Pending, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Pending, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Pending, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
Pod zell-chaos-zeebe-0 is in phase Running, but not ready. Wait for some seconds.
All Zeebe nodes are running.
Handle zbchaos job [key: 2251799813686232]
Running command with args: [verify instance-creation --awaitResult --bpmnProcessId oneReceiveMsgEvent --variables {"key": "0"}] 
Connecting to zell-chaos
Running experiment in self-managed environment.
Successfully created port forwarding tunnel
Send create process instance command, with BPMN process ID 'oneReceiveMsgEvent' and version '-1' (-1 means latest) [variables: '{"key": "0"}', awaitResult: true]
Created process instance with key 2251799813685252 on partition 1, required partition 1.
The steady-state was successfully verified!
Handle zbchaos job [key: 2251799813686305]
Running command with args: [verify readiness] 
Connecting to zell-chaos
Running experiment in self-managed environment.
All Zeebe nodes are running.
Instance 2251799813685255 [definition 2251799813685253 ] completed
--- PASS: Test_ShouldBeAbleToRunExperiments (61.86s)
PASS

Process finished with the exit code 0

@ChrisKujawa ChrisKujawa merged commit 3bdb41d into main Dec 8, 2022
@ChrisKujawa ChrisKujawa deleted the zell-migrate-message-exp branch December 8, 2022 08:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant