Redirecting the test output (to prevent the CI from leaking secrets) is preventing us to get the actual error locally

[damianavila]

Description

I faced this issue investigating failures at the time to deploy openscapes.
More details here: #691 (comment)

Value / benefit

We should be able to easily get the test output when we are working locally whereas we redirect the output in the CI environment.

Implementation details

A proposal lives in this comment: #691 (comment) (check diff) and people showed interest to have this piece as a new PR.

Tasks to complete

• PR diff with the proposed implementation
• Discuss details about the env variable that we may use to detect the GitHub env

Updates

No response

[sgibson91]

I am +1 on the suggested change change you showed in the comment. @yuvipanda and I also discussed about not running the tests with pytest at all as we use none of it's functionality. Instead, just call it as a normal function.

[choldgraf]

Added to the sprint board since @damianavila mentioned he wanted to tackle this in our team update

[damianavila]

Verified on production: https://github.com/2i2c-org/pilot-hubs/runs/3738348406?check_suite_focus=true#step:9:190