Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GeoIpProcessorFactoryTests fails on windows #44552

Closed
alpar-t opened this issue Jul 18, 2019 · 4 comments · Fixed by #45668
Closed

GeoIpProcessorFactoryTests fails on windows #44552

alpar-t opened this issue Jul 18, 2019 · 4 comments · Fixed by #45668
Labels
:Analytics/Geo Indexing, search aggregations of geo points and shapes :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >test-failure Triaged test failures from CI v6.8.3 v7.2.2 v7.3.1 v7.4.0 v8.0.0-alpha1

Comments

@alpar-t
Copy link
Contributor

alpar-t commented Jul 18, 2019

Error Message

java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip\GeoIP2-City.mmdb: java.nio.file.FileSystemException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip\GeoIP2-City.mmdb: The process cannot access the file because it is being used by another process.

   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip
   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007
   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001
Stacktrace
java.io.IOException: Could not remove the following files (in the order of attempts):
   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip\GeoIP2-City.mmdb: java.nio.file.FileSystemException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip\GeoIP2-City.mmdb: The process cannot access the file because it is being used by another process.

   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007\ingest-geoip
   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001\tempDir-007
   C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001: java.nio.file.DirectoryNotEmptyException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\os\windows-2016\modules\ingest-geoip\build\testrun\test\temp\org.elasticsearch.ingest.geoip.GeoIpProcessorFactoryTests_DBCCE894DA80882D-001

	at __randomizedtesting.SeedInfo.seed([DBCCE894DA80882D]:0)
	at org.apache.lucene.util.IOUtils.rm(IOUtils.java:319)
	at org.apache.lucene.util.TestRuleTemporaryFilesCleanup.afterAlways(TestRuleTemporaryFilesCleanup.java:216)
	at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterAlways(TestRuleAdapter.java:31)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:834)

Standard Output

[2019-07-18T03:48:50,682][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testLazyLoading] before test
[2019-07-18T03:48:51,059][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testLazyLoading] after test
[2019-07-18T03:48:51,094][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildIllegalFieldOption] before test
[2019-07-18T03:48:51,095][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildIllegalFieldOption] after test
[2019-07-18T03:48:51,103][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildDefaults] before test
[2019-07-18T03:48:51,104][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildDefaults] after test
[2019-07-18T03:48:51,120][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testCountryBuildDefaults] before test
[2019-07-18T03:48:51,121][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testCountryBuildDefaults] after test
[2019-07-18T03:48:51,127][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildFields] before test
[2019-07-18T03:48:51,128][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildFields] after test
[2019-07-18T03:48:51,134][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildNonExistingDbFile] before test
[2019-07-18T03:48:51,135][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildNonExistingDbFile] after test
[2019-07-18T03:48:51,144][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testDatabaseNotExistsInDir] before test
[2019-07-18T03:48:52,278][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testDatabaseNotExistsInDir] after test
[2019-07-18T03:48:52,284][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildTargetField] before test
[2019-07-18T03:48:52,284][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildTargetField] after test
[2019-07-18T03:48:52,288][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildDbFile] before test
[2019-07-18T03:48:52,289][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildDbFile] after test
[2019-07-18T03:48:52,294][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testDatabaseExistsInConfigDir] before test
[2019-07-18T03:48:54,208][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testDatabaseExistsInConfigDir] after test
[2019-07-18T03:48:54,213][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildWithAsnDbAndCityFields] before test
[2019-07-18T03:48:54,214][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildWithAsnDbAndCityFields] after test
[2019-07-18T03:48:54,222][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testLoadingCustomDatabase] before test
[2019-07-18T03:48:56,598][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testLoadingCustomDatabase] after test
[2019-07-18T03:48:56,604][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testAsnBuildDefaults] before test
[2019-07-18T03:48:56,605][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testAsnBuildDefaults] after test
[2019-07-18T03:48:56,609][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testSetIgnoreMissing] before test
[2019-07-18T03:48:56,610][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testSetIgnoreMissing] after test
[2019-07-18T03:48:56,613][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildWithCountryDbAndAsnFields] before test
[2019-07-18T03:48:56,614][INFO ][o.e.i.g.GeoIpProcessorFactoryTests] [testBuildWithCountryDbAndAsnFields] after test

Standard Error

NOTE: test params are: codec=Asserting(Lucene80), sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@43e35a7c), locale=en-VC, timezone=PST
NOTE: Windows Server 2016 10.0 amd64/Oracle Corporation 11.0.3 (64-bit)/cpus=16,threads=1,free=331936736,total=536870912
NOTE: All tests run in this JVM: [GeoIpProcessorFactoryTests]```

https://gradle.com/s/xddrm4zlanktc
@alpar-t alpar-t added :Analytics/Geo Indexing, search aggregations of geo points and shapes >test-failure Triaged test failures from CI v8.0.0 labels Jul 18, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo

alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 18, 2019
@alpar-t
Mute failing test
6009181 
tracked in elastic#44552
@iverase iverase added the :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP label Jul 18, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-core-features

@andrershov
Copy link
Contributor

One more failure https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+master+multijob-windows-compatibility/os=windows-2019/21/

alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
@alpar-t
Mute failing test
1a4f027 
tracked in elastic#44552
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
@alpar-t
Mute failing test
71ff250 
tracked in elastic#44552
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
@alpar-t
Mute failing test
6206ec0 
tracked in elastic#44552
alpar-t added a commit to alpar-t/elasticsearch that referenced this issue Jul 19, 2019
@alpar-t
Mute failing test
b4ea768 
tracked in elastic#44552
This was referenced Jul 22, 2019
Merged
Merged
Merged
Merged
Merged
alpar-t added a commit that referenced this issue Jul 22, 2019
@alpar-t
Mute multiple tests on Windows (master) (#44675)
3febe78 
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Fix line endings in ESJsonLayoutTests

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute AutoFollowIT.testConflictingPatterns

tracking in #44610

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* Revert "mute AutoFollowIT.testConflictingPatterns"

This reverts commit 012de08.

* mute x-pack internal cluster test windows

tracking #44610

* Mute failure unconfigured node name

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
@alpar-t
Mute multiple tests on Windows (7.x) (#44676)
b34ac66 
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Fix line endings in ESJsonLayoutTests

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Mute failure unconfigured node name

* mute x-pack internal cluster test windows

tracking #44610

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
@alpar-t
Mute multiple tests on Windows (7.3) (#44677)
9cb2ab3 
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* mute x-pack internal cluster test windows

tracking #44610

* Mute failure unconfigured node name

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
@alpar-t
Mute multiple tests on Windows (7.2) (#44678)
797fb70 
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* Disable testing conventions on Windows (#43532) (#44506)

Tests are disabled on Windows. Conventions also need to be disabled.

* mute x-pack internal cluster test windows

tracking #44610

* Mute failure unconfigured node name

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow

* Disable task for mute

* Mute JvmErgonomicsTests on windows

Tracking #44669

* mute SharedClusterSnapshotRestoreIT testParallelRestoreOperationsFromSingleSnapshot

Tracking #44671

* Mute NodeTests on Windows

Tracking #44256
alpar-t added a commit that referenced this issue Jul 22, 2019
@alpar-t
Mute multiple tests on Windows (6.8) (#44679)
05b5ba9 
* Mute failing test

tracked in #44552

* mute EvilSecurityTests

tracking in #44558

* Mute failing ForecastIT  test on windows

Tracking in #44609

* mute BasicRenormalizationIT.testDefaultRenormalization

tracked in #44613

* fix mute testDefaultRenormalization

* Increase busyWait timeout windows is slow
@ebadyano
Copy link
Contributor

One more failure: https://elasticsearch-ci.elastic.co/job/elastic+elasticsearch+7.x+multijob-windows-compatibility/os=windows-2016/23

@jakelandis jakelandis added v6.8.3 and removed v6.8.2 labels Jul 24, 2019
@jkakavas jkakavas mentioned this issue Jul 29, 2019
Closed
imotov added a commit to imotov/elasticsearch that referenced this issue Aug 16, 2019
@imotov
Fix GeoIpProcessorFactoryTests on windows
8a7df7f 
Switches windows build to use geoip database loaded on heap instead
of memory mapping it.

Closes elastic#44552
@imotov imotov mentioned this issue Aug 16, 2019
Merged
imotov added a commit that referenced this issue Aug 21, 2019
@imotov
Fix GeoIpProcessorFactoryTests on windows (#45668)
44133b7 
Switches windows build to use geoip database loaded on heap instead
of memory mapping it.

Closes #44552
imotov added a commit that referenced this issue Aug 28, 2019
@imotov
Fix GeoIpProcessorFactoryTests on windows (#45668)
28006fe 
Switches windows build to use geoip database loaded on heap instead
of memory mapping it.

Closes #44552
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
:Analytics/Geo Indexing, search aggregations of geo points and shapes :Data Management/Ingest Node Execution or management of Ingest Pipelines including GeoIP >test-failure Triaged test failures from CI v6.8.3 v7.2.2 v7.3.1 v7.4.0 v8.0.0-alpha1
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix GeoIpProcessorFactoryTests on windows imotov/elasticsearch
6 participants
@andrershov @jakelandis @alpar-t @elasticmachine @ebadyano @iverase