DTT1 - Fix JobFlow cleanup and fix logging and adjust examples

[mhamra]

Target version	Related issue	Related PR/dev branch
4.9.0		4495-dtt1-release

Description

By running some tests related to the issue #5458 the following error was found:

(dtt1) marcelo@marcelo-B460-AORUS-PRO-AC:~/wazuh/wazuh-qa/deployability$ python -m jobflow modules/jobflow/examples/agent/vagrant/test-agent-windows-complete.yaml 
[2024-06-07 16:42:48] [INFO] [44281] [MainThread] [jobflow]: Executing DAG tasks.
[2024-06-07 16:42:48] [INFO] [44281] [MainThread] [jobflow]: Executing tasks in parallel.
[2024-06-07 16:42:48] [INFO] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-manager-linux-ubuntu-22.04-amd64] Starting task.
[2024-06-07 16:42:49] [ERROR] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-manager-linux-ubuntu-22.04-amd64] Task failed with error: Error executing process task Traceback (most recent call last):
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/main.py", line 39, in <module>
    main()
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/main.py", line 35, in main
    Allocator.run(InputPayload(**vars(parse_arguments())))
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/allocation.py", line 40, in run
    return cls.__create(payload)
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/allocation.py", line 59, in __create
    instance = provider.create_instance(
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/generic/provider.py", line 71, in create_instance
    return cls._create_instance(base_dir, params, config, ssh_key)
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/vagrant/provider.py", line 61, in _create_instance
    raise ValueError("Either --instance-name or --label-issue parameter is required.")
ValueError: Either --instance-name or --label-issue parameter is required.
.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [provision-manager-linux-ubuntu-22.04-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-linux-ubuntu-20.04-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-linux-debian-12-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-linux-oracle-9-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-linux-centos-8-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-linux-redhat-9-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-windows-desktop-10-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-windows-server-2012r2-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-windows-server-2016-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-windows-server-2019-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [allocate-agent-windows-server-2022-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-linux-ubuntu-20.04-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-linux-debian-12-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-linux-oracle-9-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-linux-centos-8-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-linux-redhat-9-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-windows-desktop-10-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-windows-server-2012r2-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-windows-server-2016-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-windows-server-2019-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-0_0] [jobflow]: [run-agent-windows-server-2022-amd64-tests] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [INFO] [44281] [MainThread] [jobflow]: Executing Reverse DAG tasks.
[2024-06-07 16:42:49] [INFO] [44281] [MainThread] [jobflow]: Executing tasks in parallel.
[2024-06-07 16:42:49] [INFO] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-linux-ubuntu-20.04-amd64] Starting task.
[2024-06-07 16:42:49] [ERROR] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-linux-ubuntu-20.04-amd64] Task failed with error: Error executing process task Traceback (most recent call last):
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/main.py", line 39, in <module>
    main()
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/main.py", line 35, in main
    Allocator.run(InputPayload(**vars(parse_arguments())))
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/allocation.py", line 43, in run
    return cls.__delete(payload)
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/allocation.py", line 96, in __delete
    provider.destroy_instance(models.InstancePayload(**dict(track)))
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/generic/provider.py", line 102, in destroy_instance
    cls._destroy_instance(destroy_parameters)
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/vagrant/provider.py", line 164, in _destroy_instance
    instance = VagrantInstance(InstancePayload(**instance_params))
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/vagrant/instance.py", line 39, in __init__
    super().__init__(instance_parameters, credentials)
  File "/home/marcelo/wazuh/wazuh-qa/deployability/modules/allocation/generic/instance.py", line 40, in __init__
    raise ValueError(f"Invalid instance path: {path}")
ValueError: Invalid instance path: /tmp/wazuh-qa/agent-instance-linux-ubuntu-20.04-amd64-8933
.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-linux-debian-12-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-linux-oracle-9-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-linux-centos-8-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-linux-redhat-9-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-windows-desktop-10-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-windows-server-2012r2-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-windows-server-2016-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-windows-server-2019-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-agent-windows-server-2022-amd64] Skipping task due to dependency failure.
[2024-06-07 16:42:49] [WARNING] [44281] [ThreadPoolExecutor-1_0] [jobflow]: [allocate-manager-linux-ubuntu-22.04-amd64] Skipping task due to dependency failure.

With this error, 3 bugs were detected:

• The first is that the examples are missing a parameter as the error mentions.
• The second is because you put the character "." in error messages.
• The last and most critical is that JobFlow is trying to eliminate a machine not created because its execution failed. Not only that, but the machine you are trying to delete is not even the first one that was created, but rather it is trying to delete one that was skipped.

Tasks

• Fix Workflow Examples.
• Correct log messages.
• Analyse and investigate reported bugs.
• Fix the bug in which JobFlow tries to eliminate machines when the execution of all of them fails.
• Fix the bug where JobFlow removes VMs that were skipped due to dependency errors.

[rauldpm]

We need to check why there is a line with only a dot in the log file, we also need to fix the example YAML with the necessary inputs

ValueError: Either --instance-name or --label-issue parameter is required.
.

We need to check why the cleaning stage is failing if no instance or VM has been created, please open an issue for the @wazuh/devel-devops team

ValueError: Invalid instance path: /tmp/wazuh-qa/agent-instance-linux-ubuntu-20.04-amd64-8933
.

[fcaffieri]

Update status

All examples were fixed.
It was found where the character "." and he took off.

JobFlow bugs:

After doing research and implementing several approaches, a very simple but practical solution was found that meets what was necessary.

The problem arises because in the execution of the workflow what is called a DAG will be generated, this object contains all the tasks that need to be executed with their respective dependencies. The JobFlow creates this DAG from the YAML passed as input and sends all the tasks to execute respecting their dependencies. If any task fails for any reason, it is marked as failed. Depending on the value of the "on-error" tag, it cancels all the remaining tasks or only those that have the failed task as a dependency.
Once the execution of all the DAG tasks is finished, what is done (only in the case of having the clean-up tag) is to eliminate what was previously created, and for this, the same process is executed with the DAG but in reverse.
The problem is that this second DAG is regenerated from the YAML used as input and this causes the status of the execution of the initial tasks to be lost. With which the process will try to delete all the tasks that have the clean-up tag and does not take into account if any of them fail and do not create the instance that they should.
Nor does it take into account the order of their execution.
That said, it explains the 2 bugs mentioned.

Tried reusing the dag, saving the status of the extra tasks to share it with the clean-up, and several other approaches.
But finally, it was decided to simply take from the original DAG the tasks that were aborted and remove the tasks that finished correctly, which gives us what we should delete (it will only be deleted if it has the clean-up tag)
With this we step on the list of the new reverse DAG and the process now has everything necessary and enough intelligence to eliminate only the necessary instances.

Test:

In this test, the first task is forced to fail to validate that executing the clean-up does not eliminate any instances.

python3 -m workflow_engine modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml --log-level DEBUG --threads 1
[2024-06-14 15:01:52] [DEBUG] [186482] [MainThread] [workflow_engine]: Validating input file: modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml
[2024-06-14 15:01:52] [DEBUG] [186482] [MainThread] [workflow_engine]: Loading schema file: /home/fcaffieri/repos/wazuh-qa/.venv/lib/python3.10/site-packages/workflow_engine/schemas/schema_v1.json
[2024-06-14 15:01:52] [DEBUG] [186482] [MainThread] [workflow_engine]: Loading yaml file: modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml
[2024-06-14 15:01:52] [DEBUG] [186482] [MainThread] [workflow_engine]: Loading workflow file: modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml
[2024-06-14 15:01:52] [DEBUG] [186482] [MainThread] [workflow_engine]: Process workflow.
[2024-06-14 15:01:52] [INFO] [186482] [MainThread] [workflow_engine]: Executing DAG tasks.
[2024-06-14 15:01:52] [INFO] [186482] [MainThread] [workflow_engine]: Executing tasks in parallel.
[2024-06-14 15:01:52] [INFO] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Starting task.
[2024-06-14 15:01:52] [DEBUG] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: Running task "allocate-manager-linux-ubuntu-22.04-amd64" with arguments: ['modules/allocation/main.py', '--action=create', '--provider=vagrant', '--size=large', '--composite-name=linux-ubuntu-22.04-amd64', '--inventory-output=/tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/inventory.yaml', '--track-output=/tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/track.yaml', '--label-termination-date=1d', '--label-team=qa']
[2024-06-14 15:01:53] [ERROR] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Task failed with error: Error executing process task Traceback (most recent call last):
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/main.py", line 39, in <module>
    main()
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/main.py", line 35, in main
    Allocator.run(InputPayload(**vars(parse_arguments())))
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/allocation.py", line 40, in run
    return cls.__create(payload)
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/allocation.py", line 59, in __create
    instance = provider.create_instance(
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/generic/provider.py", line 71, in create_instance
    return cls._create_instance(base_dir, params, config, ssh_key)
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/vagrant/provider.py", line 61, in _create_instance
    raise ValueError("Either --instance-name or --label-issue parameter is required.")
ValueError: Either --instance-name or --label-issue parameter is required.

[2024-06-14 15:01:53] [ERROR] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: Fallo ejecucion de threads#####
[2024-06-14 15:01:53] [ERROR] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: Skiped tasks: {'allocate-manager-linux-ubuntu-22.04-amd64', 'run-agent-linux-ubuntu-20.04-amd64-tests', 'allocate-agent-linux-ubuntu-20.04-amd64', 'provision-manager-linux-ubuntu-22.04-amd64'}
[2024-06-14 15:01:53] [WARNING] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: [provision-manager-linux-ubuntu-22.04-amd64] Skipping task due to dependency failure.
[2024-06-14 15:01:53] [WARNING] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-agent-linux-ubuntu-20.04-amd64] Skipping task due to dependency failure.
[2024-06-14 15:01:53] [WARNING] [186482] [ThreadPoolExecutor-0_0] [workflow_engine]: [run-agent-linux-ubuntu-20.04-amd64-tests] Skipping task due to dependency failure.
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: Executing Reverse DAG tasks.
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: {'allocate-manager-linux-ubuntu-22.04-amd64', 'run-agent-linux-ubuntu-20.04-amd64-tests', 'allocate-agent-linux-ubuntu-20.04-amd64', 'provision-manager-linux-ubuntu-22.04-amd64'}
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: 1.
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: set()
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: 2.
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: {'allocate-manager-linux-ubuntu-22.04-amd64', 'run-agent-linux-ubuntu-20.04-amd64-tests', 'allocate-agent-linux-ubuntu-20.04-amd64', 'provision-manager-linux-ubuntu-22.04-amd64'}
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: 3.
[2024-06-14 15:01:53] [INFO] [186482] [MainThread] [workflow_engine]: Executing tasks in parallel.
[2024-06-14 15:01:53] [WARNING] [186482] [ThreadPoolExecutor-1_0] [workflow_engine]: [allocate-agent-linux-ubuntu-20.04-amd64] Skipping task due to dependency failure.
[2024-06-14 15:01:53] [WARNING] [186482] [ThreadPoolExecutor-1_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Skipping task due to dependency failure.

In this other test, the second task is forced to fail, to validate that the clean-up only eliminates the generated instance of the first task:

python3 -m workflow_engine modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml --log-level DEBUG --threads 1
[2024-06-13 14:34:25] [DEBUG] [18772] [MainThread] [workflow_engine]: Validating input file: modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml
[2024-06-13 14:34:25] [DEBUG] [18772] [MainThread] [workflow_engine]: Loading schema file: /home/fcaffieri/repos/wazuh-qa/.venv/lib/python3.10/site-packages/workflow_engine/schemas/schema_v1.json
[2024-06-13 14:34:25] [DEBUG] [18772] [MainThread] [workflow_engine]: Loading yaml file: modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml
[2024-06-13 14:34:25] [DEBUG] [18772] [MainThread] [workflow_engine]: Loading workflow file: modules/workflow_engine/examples/agent/vagrant/test-agent-windows-complete.yaml
[2024-06-13 14:34:25] [DEBUG] [18772] [MainThread] [workflow_engine]: Process workflow.
[2024-06-13 14:34:25] [INFO] [18772] [MainThread] [workflow_engine]: Executing DAG tasks.
[2024-06-13 14:34:25] [INFO] [18772] [MainThread] [workflow_engine]: Executing tasks in parallel.
[2024-06-13 14:34:25] [INFO] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Starting task.
[2024-06-13 14:34:25] [DEBUG] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Running task "allocate-manager-linux-ubuntu-22.04-amd64" with arguments: ['modules/allocation/main.py', '--action=create', '--provider=vagrant', '--size=large', '--composite-name=linux-ubuntu-22.04-amd64', '--instance-name=[QA]-Test-Basic-Info-', '--inventory-output=/tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/inventory.yaml', '--track-output=/tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/track.yaml', '--label-termination-date=1d', '--label-team=qa']
[2024-06-13 14:35:10] [DEBUG] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Finished task "allocate-manager-linux-ubuntu-22.04-amd64" execution with result:
[2024-06-13 14:34:25] [DEBUG] SPNEGO._GSS: Python gssapi not available, cannot use any GSSAPIProxy protocols: No module named 'gssapi'
[2024-06-13 14:34:25] [DEBUG] SPNEGO._GSS: Python gssapi IOV extension not available: No module named 'gssapi'
[2024-06-13 14:34:25] [INFO] ALLOCATOR: Creating instance at /tmp/wazuh-qa
[2024-06-13 14:34:26] [DEBUG] ALLOCATOR: No config provided. Generating from payload
[2024-06-13 14:34:26] [DEBUG] ALLOCATOR: Generating new key pair
[2024-06-13 14:34:29] [DEBUG] ALLOCATOR: Vagrantfile created. Creating instance.
[2024-06-13 14:34:29] [INFO] ALLOCATOR: Instance [QA]-Test-Basic-Info--5713 created.
[2024-06-13 14:35:06] [INFO] ALLOCATOR: Instance [QA]-Test-Basic-Info--5713 started.
[2024-06-13 14:35:09] [INFO] ALLOCATOR: The inventory file generated at /tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/inventory.yaml
[2024-06-13 14:35:09] [INFO] ALLOCATOR: The track file generated at /tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/track.yaml
[2024-06-13 14:35:10] [INFO] ALLOCATOR: SSH connection successful.
[2024-06-13 14:35:10] [INFO] ALLOCATOR: Instance [QA]-Test-Basic-Info--5713 created successfully.

[2024-06-13 14:35:10] [INFO] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Finished task in 44.88 seconds.
[2024-06-13 14:35:10] [INFO] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [provision-manager-linux-ubuntu-22.04-amd64] Starting task.
[2024-06-13 14:35:10] [DEBUG] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Running task "provision-manager-linux-ubuntu-22.04-amd64" with arguments: ['modules/provision/main.py', '--inventory=/tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/inventory.yaml', "--install={'component': 'wazuh-manager', 'type': 'assistant', 'version': '4.7.4', 'live': False}"]
[2024-06-13 14:39:07] [DEBUG] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Finished task "provision-manager-linux-ubuntu-22.04-amd64" execution with result:
[2024-06-13 14:35:10] [DEBUG] SPNEGO._GSS: Python gssapi not available, cannot use any GSSAPIProxy protocols: No module named 'gssapi'
[2024-06-13 14:35:10] [DEBUG] SPNEGO._GSS: Python gssapi IOV extension not available: No module named 'gssapi'
[2024-06-13 14:35:10] [DEBUG] PROVISIONER: Setting dependencies: {} for wazuh-manager component.
[2024-06-13 14:35:10] [INFO] PROVISIONER: Initiating provisionment.
[2024-06-13 14:35:10] [DEBUG] PROVISIONER: Running action install for components: [ComponentInfo(component='wazuh-manager', type='assistant', version='4.7.4', dependencies=None, live=False)]
[2024-06-13 14:35:10] [INFO] PROVISIONER: Provisioning "wazuh-manager"...
[2024-06-13 14:35:10] [DEBUG] PROVISIONER: Get OS family for 192.168.57.233.
[2024-06-13 14:35:10] [DEBUG] PROVISIONER: Using inventory: {'all': {'hosts': {'192.168.57.233': {'ansible_port': 22, 'ansible_user': 'vagrant', 'ansible_ssh_private_key_file': '/tmp/wazuh-qa/[QA]-Test-Basic-Info--5713/instance_key'}}}}
[2024-06-13 14:35:10] [DEBUG] PROVISIONER: Running playbook: {'hosts': '192.168.57.233', 'become': True, 'gather_facts': True, 'tasks': [{'name': 'Capture ansible_os_family', 'set_fact': {'ansible_os_family': "{{ ansible_facts['distribution_file_variety'] }}", 'cacheable': 'yes'}}]}
Using /etc/ansible/ansible.cfg as config file

PLAY [192.168.57.233] **********************************************************

TASK [Gathering Facts] *********************************************************
core/2.17/reference_appendices/interpreter_discovery.html for more information.
ok: [192.168.57.233]

TASK [Capture ansible_os_family] ***********************************************
ok: [192.168.57.233] => changed=false 
  ansible_facts:
    ansible_os_family: Debian

PLAY RECAP *********************************************************************
192.168.57.233             : ok=2    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Playbook {'hosts': '192.168.57.233', 'become': True, 'gather_facts': True, 'tasks': [{'name': 'Capture ansible_os_family', 'set_fact': {'ansible_os_family': "{{ ansible_facts['distribution_file_variety'] }}", 'cacheable': 'yes'}}]} finished with status {'skipped': {}, 'ok': {'192.168.57.233': 2}, 'dark': {}, 'failures': {}, 'ignored': {}, 'rescued': {}, 'processed': {'192.168.57.233': 1}, 'changed': {}}
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: OS family: Debian.
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Render playbook with vars: {'component': 'wazuh-manager', 'version': '4.7.4', 'live': False, 'type': 'assistant', 'dependencies': None, 'templates_path': '/home/fcaffieri/repos/wazuh-qa/deployability/modules/provision/playbooks/wazuh/assistant/install', 'templates_order': ['download.j2', 'install.j2'], 'ansible_os_family': 'Debian'}.
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Templates found: ['download.j2', 'install.j2']
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Rendering template download.j2
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Rendering template install.j2
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: [{'name': 'Install the required packages', 'shell': '\nsudo apt-get update && apt-get -y install curl\n'}, {'name': 'Download the Wazuh installation assistant', 'shell': 'curl -sO https://packages-dev.wazuh.com/4.7/wazuh-install.sh'}, {'name': 'Install wazuh-manager with assistant', 'shell': 'bash ./wazuh-install.sh -a -i'}]
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Tasks to execute: [{'name': 'Install the required packages', 'shell': '\nsudo apt-get update && apt-get -y install curl\n'}, {'name': 'Download the Wazuh installation assistant', 'shell': 'curl -sO https://packages-dev.wazuh.com/4.7/wazuh-install.sh'}, {'name': 'Install wazuh-manager with assistant', 'shell': 'bash ./wazuh-install.sh -a -i'}].
[2024-06-13 14:35:14] [INFO] PROVISIONER: Execute install for wazuh-manager.
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Using inventory: {'all': {'hosts': {'192.168.57.233': {'ansible_port': 22, 'ansible_user': 'vagrant', 'ansible_ssh_private_key_file': '/tmp/wazuh-qa/[QA]-Test-Basic-Info--5713/instance_key'}}}}
[2024-06-13 14:35:14] [DEBUG] PROVISIONER: Running playbook: {'hosts': '192.168.57.233', 'become': True, 'gather_facts': True, 'tasks': [{'name': 'Install the required packages', 'shell': '\nsudo apt-get update && apt-get -y install curl\n'}, {'name': 'Download the Wazuh installation assistant', 'shell': 'curl -sO https://packages-dev.wazuh.com/4.7/wazuh-install.sh'}, {'name': 'Install wazuh-manager with assistant', 'shell': 'bash ./wazuh-install.sh -a -i'}]}
Using /etc/ansible/ansible.cfg as config file

PLAY [192.168.57.233] **********************************************************

TASK [Gathering Facts] *********************************************************
[WARNING]: Platform linux on host 192.168.57.233 is using the discovered Python
interpreter at /usr/bin/python3.10, but future installation of another Python
interpreter could change the meaning of that path. See
https://docs.ansible.com/ansible-
core/2.17/reference_appendices/interpreter_discovery.html for more information.
ok: [192.168.57.233]

TASK [Install the required packages] *******************************************
changed: [192.168.57.233] => changed=true 
  cmd: |2-
  
    sudo apt-get update && apt-get -y install curl
  delta: '0:00:18.501855'
  end: '2024-06-13 17:35:33.089283'
  msg: ''
  rc: 0
  start: '2024-06-13 17:35:14.587428'
  stderr: ''
  stderr_lines: <omitted>
  stdout: |-
    Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB]
    Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease
    Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB]
    Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1510 kB]
    Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB]
    Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 Packages [14.1 MB]
    Get:7 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [258 kB]
    Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1920 kB]
    Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [326 kB]
    Get:10 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [858 kB]
    Get:11 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [166 kB]
    Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB]
    Get:13 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB]
    Get:14 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7588 B]
    Get:15 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B]
    Get:16 http://archive.ubuntu.com/ubuntu jammy/universe Translation-en [5652 kB]
    Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 c-n-f Metadata [286 kB]
    Get:18 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 Packages [217 kB]
    Get:19 http://archive.ubuntu.com/ubuntu jammy/multiverse Translation-en [112 kB]
    Get:20 http://archive.ubuntu.com/ubuntu jammy/multiverse amd64 c-n-f Metadata [8372 B]
    Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1729 kB]
    Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [318 kB]
    Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1986 kB]
    Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [337 kB]
    Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1086 kB]
    Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [251 kB]
    Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB]
    Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.0 kB]
    Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.7 kB]
    Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B]
    Get:31 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB]
    Get:32 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB]
    Get:33 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B]
    Get:34 http://archive.ubuntu.com/ubuntu jammy-backports/restricted amd64 c-n-f Metadata [116 B]
    Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB]
    Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.3 kB]
    Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B]
    Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/multiverse amd64 c-n-f Metadata [116 B]
    Fetched 31.8 MB in 7s (4713 kB/s)
    Reading package lists...
    Reading package lists...
    Building dependency tree...
    Reading state information...
    The following additional packages will be installed:
      libcurl4
    The following packages will be upgraded:
      curl libcurl4
    2 upgraded, 0 newly installed, 0 to remove and 100 not upgraded.
    Need to get 484 kB of archives.
    After this operation, 0 B of additional disk space will be used.
    Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 curl amd64 7.81.0-1ubuntu1.16 [194 kB]
    Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcurl4 amd64 7.81.0-1ubuntu1.16 [290 kB]
    Fetched 484 kB in 2s (288 kB/s)
    (Reading database ... (Reading database ... 5%(Reading database ... 10%(Reading database ... 15%(Reading database ... 20%(Reading database ... 25%(Reading database ... 30%(Reading database ... 35%(Reading database ... 40%(Reading database ... 45%(Reading database ... 50%(Reading database ... 55%(Reading database ... 60%(Reading database ... 65%(Reading database ... 70%(Reading database ... 75%(Reading database ... 80%(Reading database ... 85%(Reading database ... 90%(Reading database ... 95%(Reading database ... 100%(Reading database ... 64005 files and directories currently installed.)
    Preparing to unpack .../curl_7.81.0-1ubuntu1.16_amd64.deb ...
    Unpacking curl (7.81.0-1ubuntu1.16) over (7.81.0-1ubuntu1.15) ...
    Preparing to unpack .../libcurl4_7.81.0-1ubuntu1.16_amd64.deb ...
    Unpacking libcurl4:amd64 (7.81.0-1ubuntu1.16) over (7.81.0-1ubuntu1.15) ...
    Setting up libcurl4:amd64 (7.81.0-1ubuntu1.16) ...
    Setting up curl (7.81.0-1ubuntu1.16) ...
    Processing triggers for man-db (2.10.2-1) ...
    Processing triggers for libc-bin (2.35-0ubuntu3.6) ...
  stdout_lines: <omitted>

TASK [Download the Wazuh installation assistant] *******************************
changed: [192.168.57.233] => changed=true 
  cmd: curl -sO https://packages-dev.wazuh.com/4.7/wazuh-install.sh
  delta: '0:00:01.088920'
  end: '2024-06-13 17:35:34.422793'
  msg: ''
  rc: 0
  start: '2024-06-13 17:35:33.333873'
  stderr: ''
  stderr_lines: <omitted>
  stdout: ''
  stdout_lines: <omitted>

TASK [Install wazuh-manager with assistant] ************************************
fatal: [192.168.57.233]: FAILED! => changed=true 
  cmd: bash ./wazuh-install.sh -a -i
  delta: '0:03:30.746616'
  end: '2024-06-13 17:39:05.399545'
  msg: non-zero return code
  rc: 1
  start: '2024-06-13 17:35:34.652929'
  stderr: ''
  stderr_lines: <omitted>
  stdout: |-
    13/06/2024 17:35:34 INFO: Starting Wazuh installation assistant. Wazuh version: 4.7.5
    13/06/2024 17:35:34 INFO: Verbose logging redirected to /var/log/wazuh-install.log
    13/06/2024 17:35:40 WARNING: Hardware and system checks ignored.
    13/06/2024 17:35:40 INFO: Wazuh web interface port will be 443.
    13/06/2024 17:35:44 INFO: --- Dependencies ----
    13/06/2024 17:35:44 INFO: Installing apt-transport-https.
    13/06/2024 17:35:52 INFO: Wazuh development repository added.
    13/06/2024 17:35:52 INFO: --- Configuration files ---
    13/06/2024 17:35:52 INFO: Generating configuration files.
    13/06/2024 17:35:54 INFO: Created wazuh-install-files.tar. It contains the Wazuh cluster key, certificates, and passwords necessary for installation.
    13/06/2024 17:35:54 INFO: --- Wazuh indexer ---
    13/06/2024 17:35:54 INFO: Starting Wazuh indexer installation.
    13/06/2024 17:36:58 INFO: Wazuh indexer installation finished.
    13/06/2024 17:36:58 INFO: Wazuh indexer post-install configuration finished.
    13/06/2024 17:36:58 INFO: Starting service wazuh-indexer.
    13/06/2024 17:37:14 INFO: wazuh-indexer service started.
    13/06/2024 17:37:14 INFO: Initializing Wazuh indexer cluster security settings.
    13/06/2024 17:37:25 INFO: Wazuh indexer cluster initialized.
    13/06/2024 17:37:25 INFO: --- Wazuh server ---
    13/06/2024 17:37:25 INFO: Starting the Wazuh manager installation.
    13/06/2024 17:38:23 INFO: Wazuh manager installation finished.
    13/06/2024 17:38:23 INFO: Starting service wazuh-manager.
    13/06/2024 17:38:40 INFO: wazuh-manager service started.
    13/06/2024 17:38:40 INFO: Starting Filebeat installation.
    13/06/2024 17:38:48 INFO: Filebeat installation finished.
    13/06/2024 17:38:48 ERROR: Error downloading wazuh-template.json file.
    13/06/2024 17:38:48 INFO: --- Removing existing Wazuh installation ---
    13/06/2024 17:38:48 INFO: Removing Wazuh manager.
    13/06/2024 17:38:57 INFO: Wazuh manager removed.
    13/06/2024 17:38:57 INFO: Removing Wazuh indexer.
    13/06/2024 17:39:01 INFO: Wazuh indexer removed.
    13/06/2024 17:39:01 INFO: Removing Filebeat.
    13/06/2024 17:39:05 INFO: Filebeat removed.
    13/06/2024 17:39:05 INFO: Installation cleaned. Check the /var/log/wazuh-install.log file to learn more about the issue.
  stdout_lines: <omitted>

PLAY RECAP *********************************************************************
192.168.57.233             : ok=3    changed=2    unreachable=0    failed=1    skipped=0    rescued=0    ignored=0   
[2024-06-13 14:39:07] [DEBUG] PROVISIONER: Playbook {'hosts': '192.168.57.233', 'become': True, 'gather_facts': True, 'tasks': [{'name': 'Install the required packages', 'shell': '\nsudo apt-get update && apt-get -y install curl\n'}, {'name': 'Download the Wazuh installation assistant', 'shell': 'curl -sO https://packages-dev.wazuh.com/4.7/wazuh-install.sh'}, {'name': 'Install wazuh-manager with assistant', 'shell': 'bash ./wazuh-install.sh -a -i'}]} finished with status {'skipped': {}, 'ok': {'192.168.57.233': 3}, 'dark': {}, 'failures': {'192.168.57.233': 1}, 'ignored': {}, 'rescued': {}, 'processed': {'192.168.57.233': 1}, 'changed': {'192.168.57.233': 2}}
[2024-06-13 14:39:07] [INFO] PROVISIONER: Provision of "wazuh-manager" complete successfully.
[2024-06-13 14:39:07] [INFO] PROVISIONER: All components provisioned successfully.
[2024-06-13 14:39:07] [DEBUG] PROVISIONER: Provision summary: {'skipped': {}, 'ok': {'192.168.57.233': 3}, 'dark': {}, 'failures': {'192.168.57.233': 1}, 'ignored': {}, 'rescued': {}, 'processed': {'192.168.57.233': 1}, 'changed': {'192.168.57.233': 2}}

[2024-06-13 14:39:07] [INFO] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [provision-manager-linux-ubuntu-22.04-amd64] Finished task in 237.22 seconds.
[2024-06-13 14:39:07] [INFO] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-agent-linux-ubuntu-20.04-amd64] Starting task.
[2024-06-13 14:39:07] [DEBUG] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Running task "allocate-agent-linux-ubuntu-20.04-amd64" with arguments: ['modules/allocation/main.py', '--action=create', '--provider=vagrant', '--size=medium', '--composite-name=linux-ubuntu-20.04-amd64', '--inventory-output=/tmp/dtt1-poc/agent-linux-ubuntu-20.04-amd64/inventory.yaml', '--track-output=/tmp/dtt1-poc/agent-linux-ubuntu-20.04-amd64/track.yaml', '--label-termination-date=1d', '--label-team=qa']
[2024-06-13 14:39:08] [ERROR] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [allocate-agent-linux-ubuntu-20.04-amd64] Task failed with error: Error executing process task Traceback (most recent call last):
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/main.py", line 39, in <module>
    main()
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/main.py", line 35, in main
    Allocator.run(InputPayload(**vars(parse_arguments())))
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/allocation.py", line 40, in run
    return cls.__create(payload)
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/allocation.py", line 59, in __create
    instance = provider.create_instance(
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/generic/provider.py", line 71, in create_instance
    return cls._create_instance(base_dir, params, config, ssh_key)
  File "/home/fcaffieri/repos/wazuh-qa/deployability/modules/allocation/vagrant/provider.py", line 61, in _create_instance
    raise ValueError("Either --instance-name or --label-issue parameter is required.")
ValueError: Either --instance-name or --label-issue parameter is required.

[2024-06-13 14:39:08] [ERROR] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Fallo ejecucion de threads#####
[2024-06-13 14:39:08] [ERROR] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: Skiped tasks: {'allocate-agent-linux-ubuntu-20.04-amd64', 'allocate-manager-linux-ubuntu-22.04-amd64', 'provision-manager-linux-ubuntu-22.04-amd64', 'run-agent-linux-ubuntu-20.04-amd64-tests'}
[2024-06-13 14:39:08] [WARNING] [18772] [ThreadPoolExecutor-0_0] [workflow_engine]: [run-agent-linux-ubuntu-20.04-amd64-tests] Skipping task due to dependency failure.
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: Executing Reverse DAG tasks.
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: {'allocate-agent-linux-ubuntu-20.04-amd64', 'allocate-manager-linux-ubuntu-22.04-amd64', 'provision-manager-linux-ubuntu-22.04-amd64', 'run-agent-linux-ubuntu-20.04-amd64-tests'}
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: 1.
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: {'allocate-manager-linux-ubuntu-22.04-amd64', 'provision-manager-linux-ubuntu-22.04-amd64'}
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: 2.
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: {'allocate-agent-linux-ubuntu-20.04-amd64', 'run-agent-linux-ubuntu-20.04-amd64-tests'}
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: 3.
[2024-06-13 14:39:08] [INFO] [18772] [MainThread] [workflow_engine]: Executing tasks in parallel.
[2024-06-13 14:39:08] [WARNING] [18772] [ThreadPoolExecutor-1_0] [workflow_engine]: [allocate-agent-linux-ubuntu-20.04-amd64] Skipping task due to dependency failure.
[2024-06-13 14:39:08] [INFO] [18772] [ThreadPoolExecutor-1_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Starting task.
[2024-06-13 14:39:09] [DEBUG] [18772] [ThreadPoolExecutor-1_0] [workflow_engine]: Running task "allocate-manager-linux-ubuntu-22.04-amd64" with arguments: ['modules/allocation/main.py', '--action=delete', '--track-output=/tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/track.yaml']
[2024-06-13 14:39:15] [DEBUG] [18772] [ThreadPoolExecutor-1_0] [workflow_engine]: Finished task "allocate-manager-linux-ubuntu-22.04-amd64" execution with result:
[2024-06-13 14:39:09] [DEBUG] SPNEGO._GSS: Python gssapi not available, cannot use any GSSAPIProxy protocols: No module named 'gssapi'
[2024-06-13 14:39:09] [DEBUG] SPNEGO._GSS: Python gssapi IOV extension not available: No module named 'gssapi'
[2024-06-13 14:39:09] [INFO] ALLOCATOR: Deleting instance from trackfile /tmp/dtt1-poc/manager-linux-ubuntu-22.04-amd64/track.yaml
[2024-06-13 14:39:09] [DEBUG] ALLOCATOR: Destroying instance [QA]-Test-Basic-Info--5713
[2024-06-13 14:39:15] [INFO] ALLOCATOR: Instance [QA]-Test-Basic-Info--5713 deleted.

[2024-06-13 14:39:15] [INFO] [18772] [ThreadPoolExecutor-1_0] [workflow_engine]: [allocate-manager-linux-ubuntu-22.04-amd64] Finished task in 6.71 seconds.

[rauldpm]

LGTM