Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Catalog init introduces significant overhead #1268

Closed
1 of 2 tasks
xzdandy opened this issue Oct 8, 2023 · 0 comments · Fixed by #1270
Closed
1 of 2 tasks

Catalog init introduces significant overhead #1268

xzdandy opened this issue Oct 8, 2023 · 0 comments · Fixed by #1270
Labels
Bug 🐞 EVA is not working as expected
Milestone
v0.3.8

Comments

@xzdandy
Copy link
Collaborator

xzdandy commented Oct 8, 2023

Search before asking

  • I have searched the EvaDB issues and found no similar bug report.

Bug

  • Query: SELECT * FROM sqlite_data.home_sales;
  • The table sqlite_data.home_sales has 29580 rows and 5 columns.
  • The query costs 832 seconds (with batch size = 1, notice batch size = 1 exposes the significant catalog overhead).

catalog_overhead

The raw profile can be found at link.

Environment

No response

Are you willing to submit a PR?

  • Yes I'd like to help by submitting a PR!
@xzdandy xzdandy added the Bug 🐞 EVA is not working as expected label Oct 8, 2023
@gaurav274 gaurav274 mentioned this issue Oct 9, 2023
Merged
gaurav274 added a commit that referenced this issue Oct 9, 2023
@gaurav274
fix: Catalog init introduces significant overhead (#1270)
18bc547 
Fixed #1268

Moved instrumentation after the entire execution. 

<img width="1840" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/3d770689-deff-4408-bb64-9df320a95fa1">
<img width="1832" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/969ed19b-0985-4feb-ac87-045542a7b485">
@xzdandy xzdandy added this to the v0.3.8 milestone Oct 11, 2023
RichardZhangRZ pushed a commit to RichardZhangRZ/evadb that referenced this issue Oct 23, 2023
@gaurav274 @RichardZhangRZ
fix: Catalog init introduces significant overhead (georgia-tech-db#1270)
0326fc8 
Fixed georgia-tech-db#1268

Moved instrumentation after the entire execution. 

<img width="1840" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/3d770689-deff-4408-bb64-9df320a95fa1">
<img width="1832" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/969ed19b-0985-4feb-ac87-045542a7b485">
a0x8o pushed a commit to alexxx-db/eva that referenced this issue Oct 30, 2023
@gaurav274 @a0x8o
fix: Catalog init introduces significant overhead (georgia-tech-db#1270)
842cc5f 
Fixed georgia-tech-db#1268

Moved instrumentation after the entire execution. 

<img width="1840" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/3d770689-deff-4408-bb64-9df320a95fa1">
<img width="1832" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/969ed19b-0985-4feb-ac87-045542a7b485">
a0x8o pushed a commit to alexxx-db/eva that referenced this issue Nov 22, 2023
@gaurav274 @a0x8o
fix: Catalog init introduces significant overhead (georgia-tech-db#1270)
b593884 
Fixed georgia-tech-db#1268

Moved instrumentation after the entire execution.

<img width="1840" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/3d770689-deff-4408-bb64-9df320a95fa1">
<img width="1832" alt="image"
src="https://github.com/georgia-tech-db/evadb/assets/12206234/969ed19b-0985-4feb-ac87-045542a7b485">
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Bug 🐞 EVA is not working as expected
Projects
EVA Public Roadmap ⚡🚀
Status: Done
Milestone
v0.3.8
Development

Successfully merging a pull request may close this issue.

fix: Catalog init introduces significant overhead georgia-tech-db/evadb
1 participant
@xzdandy