Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(stream): fix wrong usage of chunk builder in topn #5286

Merged
merged 1 commit into from
Sep 13, 2022

Conversation

xxchan
Copy link
Member

@xxchan xxchan commented Sep 12, 2022

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.

What's changed and what's your intention?

fix #5285

@@ -204,7 +204,7 @@ impl<S: StateStore> TopNExecutorBase for InnerGroupTopNExecutorNew<S> {
)
.await?;
}
// compare the those two ranges and emit the differantial result
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The comment is confusing

@github-actions github-actions bot added the type/fix Bug fix label Sep 12, 2022
@xxchan xxchan force-pushed the xxchan/helpless-baboon branch from 88b3fe7 to 77d352f Compare September 12, 2022 18:57
@xxchan xxchan force-pushed the xxchan/helpless-baboon branch from 77d352f to 2392127 Compare September 12, 2022 19:41
@codecov
Copy link

codecov bot commented Sep 12, 2022

Codecov Report

Merging #5286 (2392127) into main (c8cd911) will decrease coverage by 0.00%.
The diff coverage is 67.94%.

@@            Coverage Diff             @@
##             main    #5286      +/-   ##
==========================================
- Coverage   73.95%   73.95%   -0.01%     
==========================================
  Files         893      893              
  Lines      137853   138102     +249     
==========================================
+ Hits       101950   102127     +177     
- Misses      35903    35975      +72     
Flag Coverage Δ
rust 73.95% <67.94%> (-0.01%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
src/frontend/src/handler/mod.rs 60.29% <0.00%> (-1.83%) ⬇️
src/meta/src/barrier/command.rs 39.31% <0.00%> (-0.31%) ⬇️
src/meta/src/rpc/service/scale_service.rs 18.09% <ø> (+0.50%) ⬆️
src/meta/src/stream/scale.rs 0.00% <0.00%> (ø)
src/rpc_client/src/error.rs 0.00% <ø> (ø)
src/storage/src/hummock/shared_buffer/mod.rs 89.97% <ø> (ø)
src/stream/src/executor/group_top_n.rs 93.54% <ø> (ø)
src/stream/src/executor/merge.rs 92.87% <0.00%> (-0.27%) ⬇️
src/stream/src/executor/top_n.rs 96.00% <ø> (ø)
src/stream/src/executor/top_n_appendonly.rs 95.74% <ø> (ø)
... and 42 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@xxchan xxchan changed the title fix(stream): fix wrong usage of chunk builder fix(stream): fix wrong usage of chunk builder in topn Sep 12, 2022
st1page
st1page previously approved these changes Sep 13, 2022
Copy link
Contributor

@st1page st1page left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@st1page st1page dismissed their stale review September 13, 2022 02:58

add some comments

Copy link
Contributor

@st1page st1page left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM to merge it as a fix. but in future, we should try to limit the chunk size in the stream executor like stream hashjoin.

@mergify mergify bot merged commit be362d9 into main Sep 13, 2022
@mergify mergify bot deleted the xxchan/helpless-baboon branch September 13, 2022 03:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/fix Bug fix
Projects
None yet
Development

Successfully merging this pull request may close these issues.

panic when stream top N has a large limit
2 participants