Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add order step to SDK processors #544

Merged
merged 1 commit into from
Oct 8, 2024
Merged

Add order step to SDK processors #544

merged 1 commit into from
Oct 8, 2024

Conversation

rtso
Copy link
Collaborator

@rtso rtso commented Oct 7, 2024

Description

This PR adds OrderByVersionStep to events and FA processors. It also updates LatestVersionTrackerStep to assume the transactions batches are coming in order.

Next PR: Parallelize storer

Testing

Run FA processor

Copy link
Collaborator Author

rtso commented Oct 7, 2024

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @rtso and the rest of your teammates on Graphite Graphite

@rtso rtso mentioned this pull request Oct 7, 2024
@rtso rtso changed the title add order step Add order step to SDK processors Oct 7, 2024
@rtso rtso requested a review from a team October 7, 2024 23:56
@rtso rtso marked this pull request as ready for review October 7, 2024 23:58
@rtso rtso force-pushed the 10-07-fa_add_order_step branch from 88b390f to 3fe6b03 Compare October 8, 2024 00:13

const UPDATE_PROCESSOR_STATUS_SECS: u64 = 1;
pub const UPDATE_PROCESSOR_STATUS_SECS: u64 = 1;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should this be a config thing?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah this can be the default, but it should be configurable per processor.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dermanyang could you include this change (accepting a polling_duration param) with the other changes you're making to LatestVersionTracker?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

will do

@rtso rtso force-pushed the 10-07-fa_add_order_step branch from 3fe6b03 to 40bc6e1 Compare October 8, 2024 21:03
@rtso rtso changed the base branch from 10-07-migrate_fa to graphite-base/544 October 8, 2024 21:07
@rtso rtso force-pushed the graphite-base/544 branch from c194dad to e4ef014 Compare October 8, 2024 21:08
@rtso rtso force-pushed the 10-07-fa_add_order_step branch from 40bc6e1 to 07482c2 Compare October 8, 2024 21:08
@rtso rtso changed the base branch from graphite-base/544 to main October 8, 2024 21:08
@rtso rtso force-pushed the 10-07-fa_add_order_step branch from 07482c2 to 8defcfd Compare October 8, 2024 21:08
@rtso rtso merged commit 4cc90a3 into main Oct 8, 2024
7 checks passed
Copy link
Collaborator Author

rtso commented Oct 8, 2024

Merge activity

  • Oct 8, 5:19 PM EDT: @rtso merged this pull request with Graphite.

@rtso rtso deleted the 10-07-fa_add_order_step branch October 8, 2024 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants