Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

acceptance: TestDockerCLI/test_url_db_override.tcl failure #30796

Closed
petermattis opened this issue Sep 29, 2018 · 6 comments
Closed

acceptance: TestDockerCLI/test_url_db_override.tcl failure #30796

petermattis opened this issue Sep 29, 2018 · 6 comments
Assignees
Labels
C-test-failure Broken test (automatically or manually discovered).
Milestone

Comments

@petermattis
Copy link
Collaborator

I've seen 2 failures of TestDockerCLI/test_url_db_override.tcl on release-2.1 CI runs: https://teamcity.cockroachdb.com/viewLog.html?buildId=933292&buildTypeId=Cockroach_UnitTests_Acceptance&tab=artifacts#!-1uziz2a3hy42,-1ozcfozzxxdsw,sq8irxtiezz4

I think the relevant portion of the logs is:

.180929 14:49:24.455725815 EXPECT TEST: START TEST: Check that the host flag overrides the host if URL is already set.
spawn /cockroach/cockroach sql --url postgresql://root@localhost:26257?sslmode=disable --host nonexistent -e select 1
Error: cannot dial server.
Is the server running?
If the server is running, check --host client-side and --advertise server-side.

dial tcp: i/o timeout
Failed running "sql"
expect: spawn id exp15 not open
    while executing
"expect {
	$text {}
	timeout { handle_timeout $text }
    }"
    (procedure "eexpect" line 2)
    invoked from within
"eexpect eof"
    (file "/go/src/github.com/cockroachdb/cockroach/cli/interactive_tests/test_url_db_override.tcl" line 91)
non-zero exit code: 1

Looks like we can't dial the server, but that seems expected here due to the --host nonexistent flag.

@petermattis petermattis added C-test-failure Broken test (automatically or manually discovered). A-cli labels Sep 29, 2018
@petermattis petermattis added this to the 2.1 milestone Sep 29, 2018
@petermattis
Copy link
Collaborator Author

I can't reproduce this failure locally on either master or release-2.1.

@petermattis
Copy link
Collaborator Author

The problem is the error that is being generated. On teamcity, the error is dial tcp: i/o timeout. Locally, the error is dial tcp: lookup nonexistent on 127.0.0.11:53: no such host. The test is looking for the term nonexistent in the output and isn't finding it. Perhaps this is a difference in DNS settings between locally and teamcity (though shouldn't they be using the same builder image?).

tbg added a commit to tbg/cockroach that referenced this issue Sep 29, 2018
@tbg
Copy link
Member

tbg commented Sep 29, 2018

I did bump the teamcity agent image (moving to ubuntu18.04) when I first saw this failure, which might be related. I've sent a PR to skip this test until @knz can take a look next week. #30798

craig bot pushed a commit that referenced this issue Sep 29, 2018
30798: cli: skip TestDockerCLI/test_url_db_override.tcl r=petermattis a=tschottdorf

See #30796.

Closes #30795.
Closes #30790.

Release note: None

Co-authored-by: Tobias Schottdorf <[email protected]>
tbg added a commit to tbg/cockroach that referenced this issue Sep 29, 2018
craig bot pushed a commit that referenced this issue Sep 29, 2018
30799: backport-2.1: cli: skip TestDockerCLI/test_url_db_override.tcl r=petermattis a=tschottdorf

Backport 1/1 commits from #30798.

/cc @cockroachdb/release

---

See #30796.

Closes #30795.
Closes #30790.

Release note: None


Co-authored-by: Tobias Schottdorf <[email protected]>
@petermattis
Copy link
Collaborator Author

petermattis commented Dec 19, 2018

@knz This test is still skipped. I recently learned that .invalid is a guaranteed invalid top-level domain. See https://tools.ietf.org/html/rfc2606. Not sure if that helps here or not.

craig bot pushed a commit that referenced this issue Jan 2, 2019
33436: cli/interactive_tests: unskip test_url_db_override r=knz a=knz

Fixes #30796.

... and use a more clearly guaranteed-bad DNS name for the expected
failure. Suggested by @petermattis.

Release note: None

33440: libroach/engine: plumb support for SingleDelete operation r=nvanbenschoten a=nvanbenschoten

Informs #8979.

This commit doesn't actually use the operation yet, but any experiments
will require this plumbing, so it made sense to pull it out and properly
test it.

Release note: None

Co-authored-by: Raphael 'kena' Poss <[email protected]>
Co-authored-by: Nathan VanBenschoten <[email protected]>
@craig craig bot closed this as completed in #33436 Jan 2, 2019
@andreimatei
Copy link
Contributor

@andreimatei andreimatei reopened this Jan 3, 2019
@knz
Copy link
Contributor

knz commented Jan 4, 2019

Yes thanks I wasn't really convinced my PR would make a difference :)

Thankfully I found a better fix. PR incoming.

craig bot pushed a commit that referenced this issue Jan 4, 2019
33502: cli/interactive_tests: deflake (more) test_url_db_override r=knz a=knz

Fixes #30796.

The test is merely testing that a `--host` flag will override the
hostname in the URL. Since there is a valid server running for
`localhost` (the host in the URL), and a test immediately before
asserts the server is running and responding, any connection error is
sufficient to demonstrate that `--host` has taken priority. There is
no need to check that the particular hostname is reported in the error
message.

Release note: None

Co-authored-by: Raphael 'kena' Poss <[email protected]>
@craig craig bot closed this as completed in #33502 Jan 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C-test-failure Broken test (automatically or manually discovered).
Projects
None yet
Development

No branches or pull requests

4 participants