[BUG] org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation is flaky #12685

soosinha · 2024-03-15T06:58:53Z

Describe the bug

Test org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation is flaky
Stacktrace

java.lang.AssertionError: expected:<4> but was:<0>
	at __randomizedtesting.SeedInfo.seed([C974C823F9FF8CBB:F79E768F519F80F0]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.failNotEquals(Assert.java:835)
	at org.junit.Assert.assertEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:633)
	at org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimple(TermsAggregatorTests.java:412)
	at org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation(TermsAggregatorTests.java:288)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
	at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
	at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
	at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
	at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
	at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
	at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
	at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:1583)

Related component

Search:Aggregations

To Reproduce

./gradlew ':server:test' --tests "org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation"

Expected behavior

Test should always pass

Additional Details

Additional context
https://build.ci.opensearch.org/job/gradle-check/34987/testReport/junit/org.opensearch.search.aggregations.bucket.terms/TermsAggregatorTests/testSimpleAggregation/

The text was updated successfully, but these errors were encountered:

soosinha · 2024-03-15T06:59:23Z

Tagging @sandeshkr419

soosinha · 2024-03-15T07:09:09Z

This was fixed here already: #12643
Resolving

kiranprakash154 · 2024-04-12T02:16:58Z

Failed again in this build - https://build.ci.opensearch.org/job/gradle-check/36882/console for an unrelated change - #13070

sandeshkr419 · 2024-04-17T16:31:12Z

@kiranprakash154 Did you pull in latest main/2.x changes because you noticed this flaky test? I fixed this one on 3/15 actually.

kiranprakash154 · 2024-04-23T21:02:34Z

That could be the reason @sandeshkr419
I haven't seen this happening so far on my PR updates, closing this for now.

VachaShah · 2024-04-25T22:46:59Z

Found this flaky test in #13398

reta · 2024-05-03T23:46:19Z

The issue is not solved: https://build.ci.opensearch.org/job/gradle-check/38318/testReport/junit/org.opensearch.search.aggregations.bucket.terms/TermsAggregatorTests/testSimpleAggregation/

java.lang.AssertionError: expected:<4> but was:<2>
	at __randomizedtesting.SeedInfo.seed([DAB5F382154D5352:E45F4D2EBD2D5F19]:0)
	at org.junit.Assert.fail(Assert.java:89)
	at org.junit.Assert.failNotEquals(Assert.java:835)
	at org.junit.Assert.assertEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:633)
	at org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimple(TermsAggregatorTests.java:419)
	at org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation(TermsAggregatorTests.java:296)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
	at java.base/java.lang.reflect.Method.invoke(Method.java:580)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1750)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:938)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:974)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:988)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:48)
	at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
	at org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
	at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
	at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:947)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:832)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:883)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:894)
	at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.tests.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.tests.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
	at org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
	at org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
	at org.apache.lucene.tests.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47)
	at org.junit.rules.RunRules.evaluate(RunRules.java:20)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:1583)

soosinha added bug Something isn't working untriaged labels Mar 15, 2024

github-actions bot added the Search:Aggregations label Mar 15, 2024

github-project-automation bot added this to Search Project Board Mar 15, 2024

github-project-automation bot moved this to 🆕 New in Search Project Board Mar 15, 2024

soosinha added flaky-test Random test failure that succeeds on second run and removed Search:Aggregations untriaged labels Mar 15, 2024

soosinha mentioned this issue Mar 15, 2024

Election scheduler should be cancelled after cluster state publication #11699

Merged

8 tasks

soosinha closed this as completed Mar 15, 2024

github-project-automation bot moved this from 🆕 New to ✅ Done in Search Project Board Mar 15, 2024

kiranprakash154 reopened this Apr 12, 2024

github-project-automation bot moved this from ✅ Done to 🏗 In progress in Search Project Board Apr 12, 2024

github-actions bot added Search:Aggregations untriaged labels Apr 12, 2024

kiranprakash154 mentioned this issue Apr 12, 2024

[Tiered Caching] Bug fix for IndicesRequestCache StaleKey management #13070

Merged

8 tasks

kiranprakash154 closed this as completed Apr 23, 2024

github-project-automation bot moved this from 🏗 In progress to ✅ Done in Search Project Board Apr 23, 2024

VachaShah mentioned this issue Apr 25, 2024

[AUTOCUT] Gradle Check Failure on push to 2.x #13398

Closed

reta reopened this May 3, 2024

github-project-automation bot moved this from ✅ Done to 🏗 In progress in Search Project Board May 3, 2024

reta mentioned this issue May 3, 2024

DATETIME_FORMATTER_CACHING_SETTING experimental feature should not default to 'true' #13532

Merged

8 tasks

andrross removed the untriaged label May 8, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BUG] org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation is flaky #12685

[BUG] org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation is flaky #12685

soosinha commented Mar 15, 2024

soosinha commented Mar 15, 2024

soosinha commented Mar 15, 2024

kiranprakash154 commented Apr 12, 2024

sandeshkr419 commented Apr 17, 2024

kiranprakash154 commented Apr 23, 2024

VachaShah commented Apr 25, 2024

reta commented May 3, 2024

[BUG] org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation is flaky #12685

[BUG] org.opensearch.search.aggregations.bucket.terms.TermsAggregatorTests.testSimpleAggregation is flaky #12685

Comments

soosinha commented Mar 15, 2024

Describe the bug

Related component

To Reproduce

Expected behavior

Additional Details

soosinha commented Mar 15, 2024

soosinha commented Mar 15, 2024

kiranprakash154 commented Apr 12, 2024

sandeshkr419 commented Apr 17, 2024

kiranprakash154 commented Apr 23, 2024

VachaShah commented Apr 25, 2024

reta commented May 3, 2024