Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consolidate TPC-H benchmarks #6

Closed
andygrove opened this issue Apr 18, 2021 · 0 comments · Fixed by #34
Closed

Consolidate TPC-H benchmarks #6

andygrove opened this issue Apr 18, 2021 · 0 comments · Fixed by #34
Assignees
@andygrove

Comments

@andygrove
Copy link
Member

There are now two copies of the benchmark crate, one for DataFusion and one for Ballista, and we should be able to combine them now.
@andygrove andygrove changed the title [Ballista] Consolidate TPC-H benchmarks Consolidate TPC-H benchmarks Apr 20, 2021
@andygrove andygrove self-assigned this Apr 22, 2021
@andygrove andygrove mentioned this issue Apr 22, 2021
Merged
EricJoy2048 added a commit to EricJoy2048/arrow-datafusion that referenced this issue Mar 3, 2022
@EricJoy2048
删除测试用的日志输出 (apache#6)
d3fda06
alamb pushed a commit that referenced this issue Oct 26, 2022
@mustafasrepo @ozankabak
Support for non-u64 types for Window Bound (#3916)
3940e36 
* Support for non u64 values inside window frames

* timestamp handling is added

* get_rank removed

* Tidy up datetime arithmetic, get rid of unwraps

* new test for validity, during window frame creation is added

* window_bound is changed to Expr (#6)

* give fixed commit hash as dependency

* remove locked flag

* Simplify some frame bound conversion functions

* Make things work the new sqlparser

* Upgrade sqlparser version to 0.26

* Minor changes

* type coercion for window frames moved to the optimizer.

Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Dandandan pushed a commit to yuuch/arrow-datafusion that referenced this issue Nov 5, 2022
@mustafasrepo @ozankabak @Dandandan
Support for non-u64 types for Window Bound (apache#3916)
2571c99 
* Support for non u64 values inside window frames

* timestamp handling is added

* get_rank removed

* Tidy up datetime arithmetic, get rid of unwraps

* new test for validity, during window frame creation is added

* window_bound is changed to Expr (apache#6)

* give fixed commit hash as dependency

* remove locked flag

* Simplify some frame bound conversion functions

* Make things work the new sqlparser

* Upgrade sqlparser version to 0.26

* Minor changes

* type coercion for window frames moved to the optimizer.

Co-authored-by: Mehmet Ozan Kabak <[email protected]>
andygrove added a commit that referenced this issue Jan 12, 2023
@andygrove @Dandandan
@JanKaul @nseekhao @waynexia
Add datafusion-substrait crate (#4543)
0d27fcb 
* Initial commit

* initial commit

* failing test

* table scan projection

* closer

* test passes, with some hacks

* use DataFrame (#2)

* update README

* update dependency

* code cleanup (#3)

* Add support for Filter operator and BinaryOp expressions (#4)

* GitHub action (#5)

* Split code into producer and consumer modules (#6)

* Support more functions and scalar types (#7)

* Use substrait 0.1 and datafusion 8.0 (#8)

* use substrait 0.1

* use datafusion 8.0

* update datafusion to 10.0 and substrait to 0.2 (#11)

* Add basic join support (#12)

* Added fetch support (#23)

Added fetch to consumer

Added limit to producer

Added unit tests for limit

Added roundtrip_fill_none() for testing when None input can be converted to 0

Update src/consumer.rs

Co-authored-by: Andy Grove <[email protected]>

Co-authored-by: Andy Grove <[email protected]>

* Upgrade to DataFusion 13.0.0 (#25)

* Add sort consumer and producer (#24)

Add consumer

Add producer and test

Modified error string

* Add serializer/deserializer (#26)

* Add plan and function extension support (#27)

* Add plan and function extension support

* Removed unwraps

* Implement GROUP BY (#28)

* Add consumer, producer and tests for aggregate relation

Change function extension registration from absolute to relative anchor
(reference)

Remove operator to/from reference

* Fixed function registration bug

* Add test

* Addressed PR comments

* Changed field reference from mask to direct reference (#29)

* Changed field reference from masked reference to direct reference

* Handle unsupported case (struct with child)

* Handle SubqueryAlias (#30)

Fixed aggregate function register bug

* Add support for SELECT DISTINCT (#31)

Add test case

* Implement BETWEEN (#32)

* Add case (#33)

* Implement CASE WHEN

* Add more case to test

* Addressed comments

* feat: support explicit catalog/schema names in ReadRel (#34)

* feat: support explicit catalog/schema names in ReadRel

Signed-off-by: Ruihang Xia <[email protected]>

* fix: use re-exported expr crate

Signed-off-by: Ruihang Xia <[email protected]>

Signed-off-by: Ruihang Xia <[email protected]>

* move files to subfolder

* RAT

* remove rust.yaml

* revert .gitignore changes

* tomlfmt

* tomlfmt

Signed-off-by: Ruihang Xia <[email protected]>
Co-authored-by: Daniël Heres <[email protected]>
Co-authored-by: JanKaul <[email protected]>
Co-authored-by: nseekhao <[email protected]>
Co-authored-by: Ruihang Xia <[email protected]>
ShiKaiWi pushed a commit to ShiKaiWi/arrow-datafusion that referenced this issue Dec 27, 2023
@tanruixiang
Support simplifying expressions such as ~ ^(ba_r|foo)$ , where the … (
9c3a537 
apache#6)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@andygrove andygrove

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Consolidate benchmarks andygrove/datafusion
1 participant
@andygrove