Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower noise of e2e tests #3822

Merged
merged 1 commit into from
Dec 22, 2022
Merged

Lower noise of e2e tests #3822

merged 1 commit into from
Dec 22, 2022

Conversation

ValarDragon
Copy link
Member

@ValarDragon ValarDragon commented Dec 22, 2022

Closes: #2653

What is the purpose of the change

Debugging E2E via CI is pretty unusable. It emits over 13000 log lines right now.

This PR:

  • Turns the debug flag off
  • Sets it s.t. in event of a tx / general action failing in E2E, we output stdout & stderr as was previously done.

I claim that this will massively reduce log output, and maintain the same debuggability.

Brief Changelog

  • Reduce E2E noisiness in CI

Testing and Verifying

This change is a trivial rework / code cleanup without any test coverage.

Documentation and Release Note

  • Does this pull request introduce a new feature or user-facing behavior changes? no
  • Is a relevant changelog entry added to the Unreleased section in CHANGELOG.md? yes
  • How is the feature or change documented? N/A

@ValarDragon ValarDragon added A:backport/v12.x backport patches to v12.x branch V:state/compatible/backport State machine compatible PR, should be backported A:backport/v13.x backport patches to v13.x branch labels Dec 22, 2022
@ValarDragon ValarDragon requested a review from p0mvn December 22, 2022 00:00
@czarcas7ic czarcas7ic self-requested a review December 22, 2022 00:08
Copy link
Member

@czarcas7ic czarcas7ic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree with this change

Copy link
Member

@p0mvn p0mvn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are cases when an actual error is produced neither to stdout, nor stderr. In such cases, if e2e happens to fail in CI but not locally, it becomes nearly impossible to debug without spitting out logs.

However, I guess we can turn on the debug flag temporarily and rerun the CI then

@p0mvn p0mvn merged commit e4e6599 into main Dec 22, 2022
@p0mvn p0mvn deleted the dev/reduce_e2e_noise branch December 22, 2022 02:49
mergify bot pushed a commit that referenced this pull request Dec 22, 2022
(cherry picked from commit e4e6599)

# Conflicts:
#	Makefile
mergify bot pushed a commit that referenced this pull request Dec 22, 2022
(cherry picked from commit e4e6599)
p0mvn pushed a commit that referenced this pull request Dec 22, 2022
(cherry picked from commit e4e6599)

Co-authored-by: Dev Ojha <[email protected]>
p0mvn added a commit that referenced this pull request Dec 22, 2022
* Lower noise of e2e tests (#3822)

(cherry picked from commit e4e6599)

# Conflicts:
#	Makefile

* Update Makefile

* Update Makefile

Co-authored-by: Dev Ojha <[email protected]>
Co-authored-by: Roman <[email protected]>
@ValarDragon
Copy link
Member Author

Feels good only 400 lines now 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A:backport/v12.x backport patches to v12.x branch A:backport/v13.x backport patches to v13.x branch T:build V:state/compatible/backport State machine compatible PR, should be backported
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

tests/e2e: revert logging all tx results
3 participants