Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: create benchmarks for merge #1857

Merged
merged 19 commits into from
Nov 20, 2023
Merged

feat: create benchmarks for merge #1857

merged 19 commits into from
Nov 20, 2023

Conversation

Blajda
Copy link
Collaborator

@Blajda Blajda commented Nov 14, 2023

Description

Implements benchmarks that are similar to Spark's Delta benchmarks.

Enable us to have a standard benchmark to measure improvements to merge and some pieces can be factored out to build a framework for bench marking delta workflows.

@github-actions github-actions bot added binding/python Issues for the Python package binding/rust Issues for the Rust crate crate/core crate/sql labels Nov 14, 2023
@github-actions github-actions bot removed the binding/python Issues for the Python package label Nov 19, 2023
@Blajda Blajda marked this pull request as ready for review November 19, 2023 17:53
@Blajda
Copy link
Collaborator Author

Blajda commented Nov 19, 2023

See #1720 for example usage

roeap
roeap previously approved these changes Nov 19, 2023
Copy link
Collaborator

@roeap roeap left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great as usual :)

crates/benchmarks/Cargo.toml Outdated Show resolved Hide resolved
@Blajda Blajda merged commit 2c8c0ec into delta-io:main Nov 20, 2023
21 checks passed
ion-elgreco pushed a commit to ion-elgreco/delta-rs that referenced this pull request Nov 20, 2023
# Description
Implements benchmarks that are similar to Spark's Delta benchmarks.

Enable us to have a standard benchmark to measure improvements to merge
and some pieces can be factored out to build a framework for bench
marking delta workflows.
ion-elgreco pushed a commit to ion-elgreco/delta-rs that referenced this pull request Nov 20, 2023
# Description
Implements benchmarks that are similar to Spark's Delta benchmarks.

Enable us to have a standard benchmark to measure improvements to merge
and some pieces can be factored out to build a framework for bench
marking delta workflows.
ion-elgreco pushed a commit to ion-elgreco/delta-rs that referenced this pull request Nov 20, 2023
# Description
Implements benchmarks that are similar to Spark's Delta benchmarks.

Enable us to have a standard benchmark to measure improvements to merge
and some pieces can be factored out to build a framework for bench
marking delta workflows.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
binding/rust Issues for the Rust crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants