Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

3 issue tests fail #877

Open
3 of 4 tasks
NoahAndrews opened this issue Apr 9, 2019 · 10 comments
Open
3 of 4 tasks

3 issue tests fail #877

NoahAndrews opened this issue Apr 9, 2019 · 10 comments

Comments

@NoahAndrews
Copy link
Contributor

NoahAndrews commented Apr 9, 2019

Describe the bug
Some tests fail on the master branch.

  • 256
  • 661
  • 677 (5-10% of the time)
  • 825

To Reproduce

  1. Check out master branch
  2. Run AllTests

Expected behavior
All tests should pass.

Environment(please complete the following information):

  • Version used: master branch
  • Java version: 1.8.0-191
  • Operating System and version: Ubuntu 16.04
@marci4
Copy link
Collaborator

marci4 commented Apr 10, 2019

For me only 256 and 825 are failing.
I think 256 will be more stable when #347 is fixed.

Going to look into 825

Best regards,
Marcel

@NoahAndrews
Copy link
Contributor Author

NoahAndrews commented Apr 10, 2019

Test 677 also fails intermittently, indicating a race condition when closing a WebSocket. See this StackOverflow answer for an easy way to run the test repeatedly. For me it fails 5-10% of the time.

@NoahAndrews
Copy link
Contributor Author

NoahAndrews commented Apr 10, 2019

Test 661 was failing because the @Test annotation was commented out: java.lang.Exception: No runnable methods. Uncommenting the annotation results in the test failing due to java.net.BindException: Address already in use.

@marci4
Copy link
Collaborator

marci4 commented Apr 14, 2019

#880 fixes the test for 661.

@marci4 marci4 added this to the Release 1.4.1 milestone Apr 16, 2019
@marci4
Copy link
Collaborator

marci4 commented Apr 25, 2019

Cannot reproduce Test825

@NoahAndrews
Copy link
Contributor Author

You said you could before. Did it just stop failing for you?

@marci4
Copy link
Collaborator

marci4 commented Apr 25, 2019

Just updated my development branch... not sure, can you take a look at this?

@NoahAndrews
Copy link
Contributor Author

It's just a naive test. It calls a non-blocking method to reconnect to the server on line 111, waits 100ms, assumes that the connection has been reestablished, and tries to send another message. With my setup, the reconnection actually takes somewhere between 100-200ms.

Issue #825 turned out to not even be any kind of bug in the library. My suggestion is to delete the test entirely.

@marci4
Copy link
Collaborator

marci4 commented Apr 28, 2019

@NoahAndrews better make it stable and maybe create a separate issue better matching the test.
I know the reason for #825 was the System.exit() but it is always good to have another test.

Best regards,
Marcel

@marci4
Copy link
Collaborator

marci4 commented May 20, 2019

825 should be more stable with #894 (350 runs without fail)

@marci4 marci4 modified the milestones: Release 1.4.1, Release 1.5.0 Mar 12, 2020
@marci4 marci4 removed this from the Release 1.5.0 milestone May 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants