Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix parquet event processor to handle miss-matching events and event … #474

Merged
merged 2 commits into from
Jul 26, 2024

Conversation

yuunlimm
Copy link
Contributor

@yuunlimm yuunlimm commented Jul 26, 2024

Description

Backfilling parquert events on testnet and mainnet was failing due to missing events for validator txn type. Initially thought that events are missing b/c fullnode wasn't up to date. However, it wasn't the case. So, we are making a general rule that event_size_info will work for user_transactions, but no promisses on other transactions.

the new behavior is that if we don't have matching events and events_size_info, we are going to panic and investigate. But for other types, they will be defaulted to 0 size_info. for those txns with missing events that are not user_transactions, we can backfill anytime if needed.

humio log

Test Plan

Running locally aginast testnet endpoint with failing txn vesrion worked.
Screenshot 2024-07-26 at 11 25 56 AM
Uploading Screenshot 2024-07-26 at 11.26.21 AM.png…

@yuunlimm yuunlimm merged commit da88021 into main Jul 26, 2024
7 checks passed
@yuunlimm yuunlimm deleted the yuunlimm/parquet-events-default branch July 26, 2024 18:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants