TestFileSystemCache is flaky #17158

homar · 2023-04-21T06:52:39Z

Got this here:

2023-04-21T02:54:35.2260637Z java.lang.AssertionError: expected [0] but found [1]
2023-04-21T02:54:35.2261163Z 	at org.testng.Assert.fail(Assert.java:94)
2023-04-21T02:54:35.2261867Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-04-21T02:54:35.2262408Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-04-21T02:54:35.2263426Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-04-21T02:54:35.2263939Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-04-21T02:54:35.2264618Z 	at org.testng.Assert.assertEquals(Assert.java:294)
2023-04-21T02:54:35.2265285Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency(TestFileSystemCache.java:116)
2023-04-21T02:54:35.2266237Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-04-21T02:54:35.2266980Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-04-21T02:54:35.2267980Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-04-21T02:54:35.2268660Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-04-21T02:54:35.2269887Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-04-21T02:54:35.2270580Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-04-21T02:54:35.2271360Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-04-21T02:54:35.2271966Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-04-21T02:54:35.2272827Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-04-21T02:54:35.2273498Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-04-21T02:54:35.2274540Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-04-21T02:54:35.2275318Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)

also in the same run got this:

2023-04-21T02:54:35.2277142Z [ERROR] io.trino.hdfs.TestFileSystemCache.testFileSystemCacheException  Time elapsed: 0.026 s  <<< FAILURE!
2023-04-21T02:54:35.2280840Z java.lang.AssertionError: expected [11] but found [12]
2023-04-21T02:54:35.2281660Z 	at org.testng.Assert.fail(Assert.java:94)
2023-04-21T02:54:35.2282173Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-04-21T02:54:35.2282907Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-04-21T02:54:35.2283437Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-04-21T02:54:35.2284135Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-04-21T02:54:35.2284651Z 	at org.testng.Assert.assertEquals(Assert.java:294)
2023-04-21T02:54:35.2285493Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheException(TestFileSystemCache.java:92)
2023-04-21T02:54:35.2286238Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-04-21T02:54:35.2287158Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-04-21T02:54:35.2287950Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-04-21T02:54:35.2288836Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-04-21T02:54:35.2289497Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-04-21T02:54:35.2290344Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-04-21T02:54:35.2290929Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-04-21T02:54:35.2291976Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-04-21T02:54:35.2331989Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-04-21T02:54:35.2332527Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-04-21T02:54:35.2333063Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-04-21T02:54:35.2333619Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2023-04-21T02:54:35.2334030Z 	at java.base/java.lang.Thread.run(Thread.java:833)

of course both passed locally several times.

The text was updated successfully, but these errors were encountered:

findepi · 2023-04-27T10:53:05Z

-04-27T10:10:40.1165523Z [ERROR] io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency  Time elapsed: 1.499 s  <<< FAILURE!
2023-04-27T10:10:40.1168087Z java.lang.AssertionError: Cache size is non zero expected [0] but found [1]
2023-04-27T10:10:40.1172635Z 	at org.testng.Assert.fail(Assert.java:94)
2023-04-27T10:10:40.1174614Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-04-27T10:10:40.1176713Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-04-27T10:10:40.1179126Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-04-27T10:10:40.1181241Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-04-27T10:10:40.1183785Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency(TestFileSystemCache.java:119)
2023-04-27T10:10:40.1188478Z 	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
2023-04-27T10:10:40.1270113Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:578)
2023-04-27T10:10:40.1272873Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-04-27T10:10:40.1295474Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-04-27T10:10:40.1297540Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-04-27T10:10:40.1299628Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-04-27T10:10:40.1301892Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-04-27T10:10:40.1304876Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-04-27T10:10:40.1307251Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
2023-04-27T10:10:40.1309673Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
2023-04-27T10:10:40.1311771Z 	at java.base/java.lang.Thread.run(Thread.java:1589)

findepi · 2023-04-27T10:56:21Z

Looks related to #13243 cc @phd3 @jitheshtr

wendigo · 2023-05-10T13:59:10Z

Happened again in https://github.com/trinodb/trino/actions/runs/4936081162/jobs/8823185574?pr=17435

wendigo · 2023-05-10T14:33:15Z

Another one: https://github.com/trinodb/trino/actions/runs/4935944601/jobs/8822879530?pr=17434

wendigo · 2023-05-10T14:33:38Z

2023-05-10T12:55:20.8834275Z [ERROR] Tests run: 124, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 12.322 s <<< FAILURE! - in TestSuite
2023-05-10T12:55:20.8837811Z [ERROR] io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency  Time elapsed: 0.842 s  <<< FAILURE!
2023-05-10T12:55:20.8838597Z java.lang.AssertionError: Cache size is non zero expected [0] but found [1]
2023-05-10T12:55:20.8839297Z 	at org.testng.Assert.fail(Assert.java:94)
2023-05-10T12:55:20.8840446Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-05-10T12:55:20.8840961Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-05-10T12:55:20.8841541Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-05-10T12:55:20.8842304Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-05-10T12:55:20.8843008Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency(TestFileSystemCache.java:118)
2023-05-10T12:55:20.8843777Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-05-10T12:55:20.8844600Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-05-10T12:55:20.8845386Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-05-10T12:55:20.8846101Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-05-10T12:55:20.8846801Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-05-10T12:55:20.8847660Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-05-10T12:55:20.8848271Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-05-10T12:55:20.8848846Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-05-10T12:55:20.8849453Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-05-10T12:55:20.8850046Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-05-10T12:55:20.8850655Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-05-10T12:55:20.8851296Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2023-05-10T12:55:20.8851809Z 	at java.base/java.lang.Thread.run(Thread.java:833)

findepi · 2023-05-11T20:05:29Z

https://github.com/trinodb/trino/actions/runs/4938776644/jobs/8828897364?pr=17214

2023-05-10T21:37:27.0393350Z 
2023-05-10T21:37:27.0484148Z [ERROR] Tests run: 124, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.383 s <<< FAILURE! - in TestSuite
2023-05-10T21:37:27.0485144Z [ERROR] io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency  Time elapsed: 1.029 s  <<< FAILURE!
2023-05-10T21:37:27.0485945Z java.lang.AssertionError: Cache size is non zero expected [0] but found [1]
2023-05-10T21:37:27.0486498Z 	at org.testng.Assert.fail(Assert.java:94)
2023-05-10T21:37:27.0487026Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-05-10T21:37:27.0487603Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-05-10T21:37:27.0488169Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-05-10T21:37:27.0488713Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-05-10T21:37:27.0489461Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency(TestFileSystemCache.java:118)
2023-05-10T21:37:27.0490320Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-05-10T21:37:27.0491167Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-05-10T21:37:27.0492105Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-05-10T21:37:27.0492875Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-05-10T21:37:27.0493618Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-05-10T21:37:27.0494370Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-05-10T21:37:27.0495249Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-05-10T21:37:27.0496017Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-05-10T21:37:27.0496771Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-05-10T21:37:27.0497519Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-05-10T21:37:27.0498285Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-05-10T21:37:27.0499188Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2023-05-10T21:37:27.0499837Z 	at java.base/java.lang.Thread.run(Thread.java:833)
2023-05-10T21:37:27.0500136Z 
2023-05-10T21:37:27.3936235Z [INFO] 
2023-05-10T21:37:27.3937599Z [INFO] Results:
2023-05-10T21:37:27.3938418Z [INFO] 
2023-05-10T21:37:27.3939073Z [ERROR] Failures: 
2023-05-10T21:37:27.3942470Z [ERROR]   TestFileSystemCache.testFileSystemCacheConcurrency:118 Cache size is non zero expected [0] but found [1]
2023-05-10T21:37:27.3943246Z [INFO] 
2023-05-10T21:37:27.3944005Z [ERROR] Tests run: 124, Failures: 1, Errors: 0, Skipped: 0
2023-05-10T21:37:27.3944622Z [INFO] 
2023-05-10T21:37:27.3951082Z [INFO]

cc @jitheshtr @phd3

jitheshtr · 2023-05-11T21:06:54Z

As TrinoFileSystemCache is a singleton and globally accessible for all hdfs filesystem operations from across all the testing modules concurrently within a JVM, the test testFileSystemCacheConcurrency() validation could be interfering with other tests that access the cache. An option to fix this is to move TestFileSystemCache module to its own runner in CI. Exploring the same to fix this.

homar · 2023-05-12T07:57:19Z

https://github.com/trinodb/trino/actions/runs/4946649822/jobs/8845013753?pr=16205

2023-05-11T13:28:21.5631010Z [ERROR] Tests run: 124, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 11.773 s <<< FAILURE! - in TestSuite
2023-05-11T13:28:21.5631660Z [ERROR] io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency  Time elapsed: 0.766 s  <<< FAILURE!
2023-05-11T13:28:21.5632611Z java.lang.AssertionError: Cache size is non zero expected [0] but found [1]
2023-05-11T13:28:21.5632961Z 	at org.testng.Assert.fail(Assert.java:94)
2023-05-11T13:28:21.5633302Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-05-11T13:28:21.5633660Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-05-11T13:28:21.5634025Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-05-11T13:28:21.5634370Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-05-11T13:28:21.5634853Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency(TestFileSystemCache.java:118)
2023-05-11T13:28:21.5635407Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-05-11T13:28:21.5636031Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-05-11T13:28:21.5637023Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-05-11T13:28:21.5637577Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-05-11T13:28:21.5638112Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-05-11T13:28:21.5638639Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-05-11T13:28:21.5639091Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-05-11T13:28:21.5639814Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-05-11T13:28:21.5640294Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-05-11T13:28:21.5640760Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-05-11T13:28:21.5641248Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-05-11T13:28:21.5641838Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2023-05-11T13:28:21.5642240Z 	at java.base/java.lang.Thread.run(Thread.java:833)

wendigo · 2023-05-15T19:10:33Z

https://github.com/trinodb/trino/actions/runs/4982690046/jobs/8918718712?pr=17507

Rubix module interacts with TestFileSystemCache in way that results in failure of testFileSystemCacheConcurrency(). Separating out TestFileSystemCache to its own profile so that it can run in isolation. Fixes trinodb#17158

losipiuk · 2023-05-17T08:33:55Z

#17517

chenjian2664 · 2023-05-18T02:00:38Z

https://github.com/trinodb/trino/actions/runs/5009046912/jobs/8977551409?pr=17196
#17196

2023-05-18T00:41:58.7705948Z 2023-05-17T18:41:58.732-0600 INFO ManageTestResources.onFinish: running checks
2023-05-18T00:41:58.8705473Z 2023-05-17T18:41:58.829-0600 WARNING Error communicating with bookKeeper
2023-05-18T00:41:58.8706418Z com.google.shaded.shaded.common.util.concurrent.UncheckedExecutionException: java.lang.ArithmeticException: / by zero
2023-05-18T00:41:58.8707546Z 	at com.google.shaded.shaded.common.cache.LocalCache$Segment.get(LocalCache.java:2050)
2023-05-18T00:41:58.8708099Z 	at com.google.shaded.shaded.common.cache.LocalCache.get(LocalCache.java:3952)
2023-05-18T00:41:58.8708921Z 	at com.google.shaded.shaded.common.cache.LocalCache$LocalManualCache.get(LocalCache.java:4871)
2023-05-18T00:41:58.8709622Z 	at com.qubole.rubix.bookkeeper.BookKeeper.getCacheStatus(BookKeeper.java:287)
2023-05-18T00:41:58.8710280Z 	at com.qubole.rubix.bookkeeper.FileDownloader.getFileDownloadRequestChains(FileDownloader.java:135)
2023-05-18T00:41:58.8710983Z 	at com.qubole.rubix.bookkeeper.RemoteFetchProcessor.processRequest(RemoteFetchProcessor.java:155)
2023-05-18T00:41:58.8711663Z 	at com.qubole.rubix.bookkeeper.RemoteFetchProcessor.runOneIteration(RemoteFetchProcessor.java:144)
2023-05-18T00:41:58.8712342Z 	at com.google.shaded.shaded.common.util.concurrent.AbstractScheduledService$ServiceDelegate$Task.run(AbstractScheduledService.java:193)
2023-05-18T00:41:58.8712981Z 	at com.google.shaded.shaded.common.util.concurrent.Callables$4.run(Callables.java:119)
2023-05-18T00:41:58.8713470Z 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
2023-05-18T00:41:58.8713940Z 	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
2023-05-18T00:41:58.8714510Z 	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305)
2023-05-18T00:41:58.8715099Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-05-18T00:41:58.8715617Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2023-05-18T00:41:58.8716131Z 	at java.base/java.lang.Thread.run(Thread.java:833)
2023-05-18T00:41:58.8716480Z Caused by: java.lang.ArithmeticException: / by zero
2023-05-18T00:41:58.8716904Z 	at com.qubole.rubix.spi.CacheUtil.getLocalDirFor(CacheUtil.java:305)
2023-05-18T00:41:58.8717340Z 	at com.qubole.rubix.spi.CacheUtil.getDirectory(CacheUtil.java:274)
2023-05-18T00:41:58.8717802Z 	at com.qubole.rubix.spi.CacheUtil.getLocalPath(CacheUtil.java:165)
2023-05-18T00:41:58.8718302Z 	at com.qubole.rubix.bookkeeper.FileMetadata.findGenerationNumber(FileMetadata.java:174)
2023-05-18T00:41:58.8718804Z 	at com.qubole.rubix.bookkeeper.FileMetadata.<init>(FileMetadata.java:77)
2023-05-18T00:41:58.8719274Z 	at com.qubole.rubix.bookkeeper.BookKeeper.lambda$getCacheStatus$0(BookKeeper.java:287)
2023-05-18T00:41:58.8719797Z 	at com.google.shaded.shaded.common.cache.LocalCache$LocalManualCache$1.load(LocalCache.java:4876)
2023-05-18T00:41:58.8720365Z 	at com.google.shaded.shaded.common.cache.LocalCache$LoadingValueReference.loadFuture(LocalCache.java:3528)
2023-05-18T00:41:58.8720907Z 	at com.google.shaded.shaded.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2277)
2023-05-18T00:41:58.8721434Z 	at com.google.shaded.shaded.common.cache.LocalCache$Segment.lockedGetOrLoad(LocalCache.java:2154)
2023-05-18T00:41:58.8721938Z 	at com.google.shaded.shaded.common.cache.LocalCache$Segment.get(LocalCache.java:2044)
2023-05-18T00:41:58.8722262Z 	... 14 more
2023-05-18T00:41:58.8722381Z 
2023-05-18T00:41:58.9881703Z [ERROR] Tests run: 129, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 11.672 s <<< FAILURE! - in TestSuite
2023-05-18T00:41:58.9882674Z [ERROR] io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency  Time elapsed: 0.766 s  <<< FAILURE!
2023-05-18T00:41:58.9883370Z java.lang.AssertionError: Cache size is non zero expected [0] but found [1]
2023-05-18T00:41:58.9884187Z 	at org.testng.Assert.fail(Assert.java:94)
2023-05-18T00:41:58.9884601Z 	at org.testng.Assert.failNotEquals(Assert.java:513)
2023-05-18T00:41:58.9884987Z 	at org.testng.Assert.assertEqualsImpl(Assert.java:135)
2023-05-18T00:41:58.9885372Z 	at org.testng.Assert.assertEquals(Assert.java:116)
2023-05-18T00:41:58.9885716Z 	at org.testng.Assert.assertEquals(Assert.java:284)
2023-05-18T00:41:58.9886204Z 	at io.trino.hdfs.TestFileSystemCache.testFileSystemCacheConcurrency(TestFileSystemCache.java:120)
2023-05-18T00:41:58.9886772Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
2023-05-18T00:41:58.9887318Z 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
2023-05-18T00:41:58.9888308Z 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
2023-05-18T00:41:58.9888803Z 	at java.base/java.lang.reflect.Method.invoke(Method.java:568)
2023-05-18T00:41:58.9889290Z 	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:104)
2023-05-18T00:41:58.9889767Z 	at org.testng.internal.Invoker.invokeMethod(Invoker.java:645)
2023-05-18T00:41:58.9890176Z 	at org.testng.internal.Invoker.invokeTestMethod(Invoker.java:851)
2023-05-18T00:41:58.9890608Z 	at org.testng.internal.Invoker.invokeTestMethods(Invoker.java:1177)
2023-05-18T00:41:58.9891089Z 	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:129)
2023-05-18T00:41:58.9891562Z 	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:112)
2023-05-18T00:41:58.9892052Z 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
2023-05-18T00:41:58.9892581Z 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
2023-05-18T00:41:58.9892993Z 	at java.base/java.lang.Thread.run(Thread.java:833)
2023-05-18T00:41:58.9893180Z 
2023-05-18T00:41:59.3287373Z [INFO] 
2023-05-18T00:41:59.3287855Z [INFO] Results:
2023-05-18T00:41:59.3288175Z [INFO] 
2023-05-18T00:41:59.3288548Z [ERROR] Failures: 
2023-05-18T00:41:59.3289299Z [ERROR]   TestFileSystemCache.testFileSystemCacheConcurrency:120 Cache size is non zero expected [0] but found [1]
2023-05-18T00:41:59.3289921Z [INFO] 
2023-05-18T00:41:59.3293005Z [ERROR] Tests run: 129, Failures: 1, Errors: 0, Skipped: 0

Rubix module interacts with TestFileSystemCache in way that results in failure of testFileSystemCacheConcurrency(). Separating out TestFileSystemCache to its own profile so that it can run in isolation. Fixes #17158

homar mentioned this issue Apr 21, 2023

Implement table changes function for delta lake #16205

Merged

This was referenced Apr 27, 2023

Run trino-hdfs tests single-threaded #17266

Merged

Reject property names with dot #17241

Merged

findepi closed this as completed in #17266 Apr 28, 2023

wendigo reopened this May 10, 2023

wendigo mentioned this issue May 10, 2023

Use shade plugin version from airbase #17435

Merged

wendigo mentioned this issue May 10, 2023

Update maven failsafe plugin to 3.1.0 #17434

Merged

martint mentioned this issue May 11, 2023

Remove unused methods and code #17448

Merged

losipiuk mentioned this issue May 11, 2023

Add flag if task is speculative to TaskStatus #17318

Merged

findepi mentioned this issue May 11, 2023

Drop Delta cache without metastore communication #17214

Merged

jitheshtr mentioned this issue May 12, 2023

Isolate TestFileSystemCache to fix its flakiness #17467

Merged

losipiuk mentioned this issue May 12, 2023

Prioritize non-speculative tasks in scheduler and node allocator #17465

Merged

losipiuk mentioned this issue May 15, 2023

Prefer killing speculative tasks #17478

Merged

alexjo2144 mentioned this issue May 15, 2023

Migrate Hive DirectoryLister to TrinoFileSystem #17323

Merged

hashhar mentioned this issue May 17, 2023

Add dependency-reduced-pom.xml files to .gitignore #17533

Merged

phd3 closed this as completed in #17467 May 19, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TestFileSystemCache is flaky #17158

TestFileSystemCache is flaky #17158

homar commented Apr 21, 2023

findepi commented Apr 27, 2023

findepi commented Apr 27, 2023

wendigo commented May 10, 2023

wendigo commented May 10, 2023

wendigo commented May 10, 2023

findepi commented May 11, 2023

jitheshtr commented May 11, 2023

homar commented May 12, 2023

wendigo commented May 15, 2023

losipiuk commented May 17, 2023

chenjian2664 commented May 18, 2023 •

edited

Loading

TestFileSystemCache is flaky #17158

TestFileSystemCache is flaky #17158

Comments

homar commented Apr 21, 2023

findepi commented Apr 27, 2023

findepi commented Apr 27, 2023

wendigo commented May 10, 2023

wendigo commented May 10, 2023

wendigo commented May 10, 2023

findepi commented May 11, 2023

jitheshtr commented May 11, 2023

homar commented May 12, 2023

wendigo commented May 15, 2023

losipiuk commented May 17, 2023

chenjian2664 commented May 18, 2023 • edited Loading

chenjian2664 commented May 18, 2023 •

edited

Loading