Avoid failed workflow if a pytest fails

[davidcr01]

Description

We want to modify the Python test migrated in #20. In the Python test, if a pytest function fails, the complete task fails. For example, in the following GHA, the workflow fails because of a failed pytest: wazuh/wazuh#25534

Although this behavior is correct, we want to make the workflow finish with other success, rather than fail in this kind of case. It seems that there are more options rather than success or failure in GitHub Actions, something like a warning exit code.

Tasks

• Decide the workflow exit status when a pytest fails
• Apply the change
• Validate the new behavior

[fcaffieri]

Update report

After discussing the scope of the issue with the team, it was decided to generate 2 types of outputs:

1. Warning: Failure in Wazuh tests
2. Error: Failure in the installation wizard
   This is because what is being tested in the test is the installation wizard and not detecting bugs in Wazuh
   We will work on implementing these situations.

[fcaffieri]

Update report

After implementing the error handler for workflows, it was detected that GitHub actions only support 2 output values:

• 0: All steps were executed correctly and the action is marked as green
• 1: Some steps failed, it is marked as red and the entire action failed.

Based on this premise, a solution was implemented where if the test of the Wazuh installation tools fails, the entire test is reported as failed. On the contrary, if only the test of the Wazuh components fails, the test is reported as successful (since the objective of the test is to validate the installation tools and not the functionality of Wazuh). Still, warnings are left in the component testing step, for later information to the responsible team.

Improvements

Additionally, bugs on the installation wizards were fixed, and the products of the migration to 5.0.0.
Finally, an improvement was incorporated where if a crucial step fails, the execution of the remaining steps is interrupted, since the test is considered failed.

Tests

Installation Wizard (Distributed)

• Stop execution of steps on failures:
  https://github.com/wazuh/wazuh-installation-assistant/actions/runs/12518212911/job/34920285045
  

https://github.com/wazuh/wazuh-installation-assistant/actions/runs/12518291928/job/34920498369

• Bug fixed in the installation wizard
  
  

• All test works successfully
  https://github.com/wazuh/wazuh-installation-assistant/actions/runs/12518596246/job/34921311838
  
  

• Component test fail - Test installation passed
  https://github.com/wazuh/wazuh-installation-assistant/actions/runs/12518849129/job/34921959360
  

[fcaffieri]

Update report

Working on fixing the AIO install assistant:

[fcaffieri]