Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-enable HeapAttackIT #104107

Merged
merged 4 commits into from
Jan 10, 2024
Merged

Re-enable HeapAttackIT #104107

merged 4 commits into from
Jan 10, 2024

Conversation

dnhatn
Copy link
Member

@dnhatn dnhatn commented Jan 8, 2024

This PR enables ESQL heap attack tests. I have run this suite over 500 iterations with different hardware configurations for the last two days, and all have been successful with the changes in #104159.

Additionally, this PR adds an action that can trigger OOM to generate a heap dump if a test takes more than 5 minutes. I've seen cases (previously with our CI) where the test didn't result in OOM but was taking too long. Having the ability to inspect the heap in such cases would be beneficial.

Closes #103527
Closes #100678

@dnhatn dnhatn added :Analytics/ES|QL AKA ESQL >test Issues or PRs that are addressing/adding tests and removed WIP labels Jan 10, 2024
@dnhatn dnhatn marked this pull request as ready for review January 10, 2024 02:06
@dnhatn dnhatn requested a review from a team as a code owner January 10, 2024 02:06
@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Jan 10, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-analytics-geo (Team:Analytics)

@@ -5,6 +5,13 @@
* in compliance with, at your election, the Elastic License 2.0 or the Server
* Side Public License, v 1.
*/
import org.elasticsearch.gradle.internal.info.BuildParams

apply plugin: 'elasticsearch.legacy-yaml-rest-test'
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This was moved from the parent module.

@@ -6,6 +6,13 @@
* Side Public License, v 1.
*/

import org.elasticsearch.gradle.internal.info.BuildParams
apply plugin: 'elasticsearch.legacy-yaml-rest-test'
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This also was moved from the parent module.

List<int[]> values = new ArrayList<>();
return channel -> {
while (true) {
values.add(new int[1024 * 1024]);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rude.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wonderful.

@dnhatn
Copy link
Member Author

dnhatn commented Jan 10, 2024

@mark-vieira @nik9000 Thanks for reviews.

@dnhatn dnhatn merged commit 709c0f5 into elastic:main Jan 10, 2024
15 checks passed
@dnhatn dnhatn deleted the dump-heap-attack branch January 10, 2024 16:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Analytics/ES|QL AKA ESQL Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test Issues or PRs that are addressing/adding tests v8.13.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[CI] HeapAttackIT classMethod failing [CI] HeapAttackIT testManyConcat failing
4 participants