Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Replace BigArrays with primitive ones in BigInt aggregation #11392

Merged

Conversation

skrzypo987
Copy link
Member

Commit extracted from #11031

Description

Is this change a fix, improvement, new feature, refactoring, or other?

Is this a change to the core query engine, a connector, client library, or the SPI interfaces? (be specific)

How would you describe this change to a non-technical end user or system administrator?

Related issues, pull requests, and links

Documentation

( ) No documentation is needed.
( ) Sufficient documentation is included in this PR.
( ) Documentation PR is available with #prnumber.
( ) Documentation issue #issuenumber is filed, and can be handled later.

Release notes

( ) No release notes entries required.
( ) Release notes entries required with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Mar 9, 2022
@skrzypo987 skrzypo987 requested a review from sopel39 March 9, 2022 12:29
Copy link
Member

@sopel39 sopel39 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mind automation. There are checkstyle failures

LongBigArray and IntBigArray with long[] and int[].

The original implementation was done because Java prior to version 11
had some problems handling humongous (very big) objects and that sometimes
caused giant GC pauses. Since Java 11 humongous objects are first allocated
on eden which mitigates problems with collecting them.

before:
BenchmarkGroupByHash.bigintGroupByHash     1           true  avgt   10   60,944 ±   1,730   ns/op
BenchmarkGroupByHash.bigintGroupByHash     1          false  avgt   10   58,081 ±   1,310   ns/op
after:
BenchmarkGroupByHash.bigintGroupByHash     1           true  avgt   10   49,011 ±   1,100   ns/op
BenchmarkGroupByHash.bigintGroupByHash     1          false  avgt   10   47,924 ±   2,408   ns/op
@skrzypo987 skrzypo987 force-pushed the skrzypo/060-long-aggregation-arrays branch from a0c70fb to ba9fcdc Compare March 9, 2022 15:22
@sopel39 sopel39 merged commit 70dd978 into trinodb:master Mar 10, 2022
@sopel39 sopel39 mentioned this pull request Mar 10, 2022
@github-actions github-actions bot added this to the 374 milestone Mar 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

2 participants