-
Notifications
You must be signed in to change notification settings - Fork 2.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix bindings prune containers flaky test #9902
Fix bindings prune containers flaky test #9902
Conversation
In containers#9863 prune containers filter params were narrowed to support only those required by http API. name filter in bindings was replaced by until filter, which is not a good match, as until filters are causing tests to be flaky. Signed-off-by: Jakub Guzik <[email protected]>
@rhatdan FYI |
That works, but I would love to get a working tests in. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I prefer to use Skip(...)
and not remove the code, so we leave some breadcrumbs for the future.
Can you elaborate on what is causing the flakes? (would be great in the commit message and a comment in the test)
@rhatdan @vrothberg The problem is in bindings every test is instantiated with default container:
This excludes using label as a filter in this test. I maybe lack experience, but saw that adding label is not that easy and possibly not worthy, as it is tested in apiv2 tests. I tried a second filter allowed which is until, but it causes tests to flake. In my opinion, it is related to the time conversions which are occurring in the API (one format to another) and accuracy. If you include sleep in this test, it should pass. So, it is impossible to recreate previous test behavior (which was wrong, because filters from the list were used here) as the only filter that can be used is a label (or until with sleep if you want). Thus, in my opinion, skip is not valid here. You would skip invalid behavior. |
And unitil is added by me, previously name filter was here. |
@edsantiago may have an idea how to make it pass |
@vrothberg my alternative idea for sleep until would be something like 0ns or 1ns and keeping fingers crossed that it is enough. |
@vrothberg @jmguzik sorry, this is way above my head. I don't know ginkgo at all. |
So, then my proposition would be to test with ns or sleep if you really want until check. @vrothberg please let me know what you prefer. |
/approve |
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: jmguzik, rhatdan The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
In #9863 prune containers filter params were narrowed to support only those
required by http API. name filter in bindings was replaced by until filter,
which is not a good match, as until filters are causing tests to be flaky.
Signed-off-by: Jakub Guzik [email protected]