Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flaky-test: ReplicatorTest.testReplication #9458

Closed
lhotari opened this issue Feb 3, 2021 · 5 comments
Closed

Flaky-test: ReplicatorTest.testReplication #9458

lhotari opened this issue Feb 3, 2021 · 5 comments
Labels
lifecycle/stale type/bug The PR fixed a bug or issue reported a bug

Comments

@lhotari
Copy link
Member

lhotari commented Feb 3, 2021

org.apache.pulsar.broker.service.ReplicatorTest is flaky. The testReplication test method fails sporadically.

org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:94)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:295)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-02-01T01:35:59.4539012Z
example failure 2021-02-01T01:35:59.4493873Z
example failure 2021-01-30T07:38:30.7674464Z
example failure 2021-01-30T07:38:30.7639225Z
example failure 2021-01-29T04:50:34.2255253Z
example failure 2021-01-29T04:50:34.2177223Z
example failure 2021-01-29T04:34:55.1330899Z
example failure 2021-01-29T04:34:55.1231886Z
example failure 2021-01-29T00:06:45.0299447Z
example failure 2021-01-29T00:06:45.0264300Z
example failure 2021-01-28T18:15:18.2988053Z
example failure 2021-01-28T18:15:18.2959689Z
example failure 2021-01-26T21:41:26.0735469Z
example failure 2021-01-26T21:41:26.0647243Z
example failure 2021-01-26T02:02:01.4445808Z
example failure 2021-01-26T02:02:01.4403253Z
example failure 2021-01-25T22:27:52.3506097Z
example failure 2021-01-25T22:27:52.3451779Z
example failure 2021-01-25T12:24:27.5671729Z
example failure 2021-01-25T12:24:27.5516331Z
example failure 2021-01-22T11:39:17.6190592Z
example failure 2021-01-22T11:39:17.6113423Z
example failure 2021-01-21T21:09:43.3224477Z
example failure 2021-01-21T21:09:43.3183952Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:94)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:295)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:295)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-02-02T13:46:14.3051150Z
example failure 2021-02-02T13:46:14.2968169Z
example failure 2021-02-01T03:56:01.5185348Z
example failure 2021-02-01T03:56:01.5079380Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:295)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

@lhotari lhotari added the type/bug The PR fixed a bug or issue reported a bug label Feb 3, 2021
@lhotari
Copy link
Member Author

lhotari commented Feb 3, 2021

Similar issues in testReplicatePeekAndSkip method.

org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:94)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplicatePeekAndSkip(ReplicatorTest.java:451)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-02-01T01:35:59.3930831Z
example failure 2021-01-30T07:38:30.7445931Z
example failure 2021-01-29T04:50:34.1816114Z
example failure 2021-01-29T04:34:55.0968967Z
example failure 2021-01-29T00:06:44.9846566Z
example failure 2021-01-28T18:15:17.5098400Z
example failure 2021-01-26T21:41:25.9914089Z
example failure 2021-01-26T02:02:01.4166027Z
example failure 2021-01-25T22:27:52.2915803Z
example failure 2021-01-25T12:24:27.4867964Z
example failure 2021-01-22T11:39:17.5795634Z
example failure 2021-01-21T21:09:43.2682925Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:94)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplicatePeekAndSkip(ReplicatorTest.java:451)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


org.testng.internal.thread.ThreadTimeoutException: Method org.apache.pulsar.broker.service.ReplicatorTest.testReplicatePeekAndSkip() didn't finish within the time-out 30000

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-02-01T09:23:35.2532528Z
example failure 2021-01-29T03:33:46.4897010Z
example failure 2021-01-26T03:18:50.9534725Z
example failure 2021-01-25T22:26:49.8987651Z
example failure 2021-01-23T07:33:59.9204221Z
example failure 2021-01-12T15:04:54.5697148Z

Full exception stacktrace 
org.testng.internal.thread.ThreadTimeoutException: Method org.apache.pulsar.broker.service.ReplicatorTest.testReplicatePeekAndSkip() didn't finish within the time-out 30000
	at org.testng.internal.MethodInvocationHelper.invokeWithTimeoutWithNewExecutor(MethodInvocationHelper.java:371)
	at org.testng.internal.MethodInvocationHelper.invokeWithTimeout(MethodInvocationHelper.java:282)
	at org.testng.internal.TestInvoker.invokeMethod(TestInvoker.java:605)
	at org.testng.internal.TestInvoker.retryFailed(TestInvoker.java:214)
	at org.testng.internal.MethodRunner.runInSequence(MethodRunner.java:58)
	at org.testng.internal.TestInvoker$MethodInvocationAgent.invoke(TestInvoker.java:822)
	at org.testng.internal.TestInvoker.invokeTestMethods(TestInvoker.java:147)
	at org.testng.internal.TestMethodWorker.invokeTestMethods(TestMethodWorker.java:146)
	at org.testng.internal.TestMethodWorker.run(TestMethodWorker.java:128)
	at java.util.ArrayList.forEach(ArrayList.java:1257)
	at org.testng.TestRunner.privateRun(TestRunner.java:764)
	at org.testng.TestRunner.run(TestRunner.java:585)
	at org.testng.SuiteRunner.runTest(SuiteRunner.java:384)
	at org.testng.SuiteRunner.runSequentially(SuiteRunner.java:378)
	at org.testng.SuiteRunner.privateRun(SuiteRunner.java:337)
	at org.testng.SuiteRunner.run(SuiteRunner.java:286)
	at org.testng.SuiteRunnerWorker.runSuite(SuiteRunnerWorker.java:53)
	at org.testng.SuiteRunnerWorker.run(SuiteRunnerWorker.java:96)
	at org.testng.TestNG.runSuitesSequentially(TestNG.java:1218)
	at org.testng.TestNG.runSuitesLocally(TestNG.java:1140)
	at org.testng.TestNG.runSuites(TestNG.java:1069)
	at org.testng.TestNG.run(TestNG.java:1037)
	at org.apache.maven.surefire.testng.TestNGExecutor.run(TestNGExecutor.java:135)
	at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.executeSingleClass(TestNGDirectoryTestSuite.java:112)
	at org.apache.maven.surefire.testng.TestNGDirectoryTestSuite.execute(TestNGDirectoryTestSuite.java:99)
	at org.apache.maven.surefire.testng.TestNGProvider.invoke(TestNGProvider.java:146)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
	at org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)


org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplicatePeekAndSkip(ReplicatorTest.java:451)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-02-02T13:46:14.2519579Z
example failure 2021-02-01T03:56:01.4441012Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplicatePeekAndSkip(ReplicatorTest.java:451)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

@sijie sijie mentioned this issue Feb 3, 2021
Open
@lhotari lhotari mentioned this issue Feb 12, 2021
Closed
@lhotari
Copy link
Member Author

lhotari commented Mar 16, 2021

Flaky-test: org.apache.pulsar.broker.service.ReplicatorTest.testReplication
Number of failures: 6

org.apache.pulsar.broker.service.ReplicatorTest is flaky. The testReplication test method fails sporadically.

org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:297)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-03-08T00:24:45.4688122Z
example failure 2021-03-08T00:24:45.4458137Z
example failure 2021-03-05T08:57:35.5205645Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:297)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:296)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-02-23T18:43:31.6518257Z
example failure 2021-02-23T18:43:31.6481685Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException$AuthorizationException: Client is not authorized to Produce
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:979)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:296)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)


org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: HTTP get request failed: Internal Server Error
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1027)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.<init>(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:297)

Usage tip: To enable automatic navigation to failure message, open the following links with CTRL/CMD-click.
example failure 2021-03-05T08:57:35.5257288Z

Full exception stacktrace 
org.apache.pulsar.client.api.PulsarClientException: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: HTTP get request failed: Internal Server Error
	at org.apache.pulsar.client.api.PulsarClientException.unwrap(PulsarClientException.java:1027)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:95)
	at org.apache.pulsar.broker.service.ReplicatorTestBase$MessageProducer.(ReplicatorTestBase.java:301)
	at org.apache.pulsar.broker.service.ReplicatorTest.testReplication(ReplicatorTest.java:297)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.testng.internal.MethodInvocationHelper.invokeMethod(MethodInvocationHelper.java:132)
	at org.testng.internal.InvokeMethodRunnable.runOne(InvokeMethodRunnable.java:45)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:73)
	at org.testng.internal.InvokeMethodRunnable.call(InvokeMethodRunnable.java:11)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: org.apache.pulsar.client.api.PulsarClientException: HTTP get request failed: Internal Server Error
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1908)
	at org.apache.pulsar.client.impl.ProducerBuilderImpl.create(ProducerBuilderImpl.java:93)
	... 14 more
Caused by: org.apache.pulsar.client.api.PulsarClientException: HTTP get request failed: Internal Server Error
	at org.apache.pulsar.client.impl.HttpClient.lambda$null$1(HttpClient.java:215)
	at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774)
	at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:750)
	at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488)
	at java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:1975)
	at org.asynchttpclient.netty.NettyResponseFuture.loadContent(NettyResponseFuture.java:222)
	at org.asynchttpclient.netty.NettyResponseFuture.done(NettyResponseFuture.java:257)
	at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.finishUpdate(AsyncHttpClientHandler.java:241)
	at org.asynchttpclient.netty.handler.HttpHandler.handleChunk(HttpHandler.java:114)
	at org.asynchttpclient.netty.handler.HttpHandler.handleRead(HttpHandler.java:143)
	at org.asynchttpclient.netty.handler.AsyncHttpClientHandler.channelRead(AsyncHttpClientHandler.java:78)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436)
	at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324)
	at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296)
	at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
	at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
	at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
	at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
	at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:792)
	at io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe$1.run(AbstractEpollChannel.java:387)
	at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164)
	at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472)
	at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:384)
	at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989)
	at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
	at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
	... 1 more

@lhotari
Copy link
Member Author

lhotari commented Mar 16, 2021

This issue might have been mitigated with earlier fixes, since there's no recent failures. The most recent failure is 2021-03-08. It seems that #9823 and #9787 have eliminated the flakiness of ReplicatorTest.testReplication.

@codelipenghui
Copy link
Contributor

The issue had no activity for 30 days, mark with Stale label.

@tisonkun
Copy link
Member

Closed as stale. Please create a new issue if it's still relevant to the maintained versions.

@tisonkun tisonkun closed this as not planned Won't fix, can't repro, duplicate, stale Dec 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
lifecycle/stale type/bug The PR fixed a bug or issue reported a bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@lhotari @codelipenghui @tisonkun