fix parquet event processor to handle miss-matching events and event … #474
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Backfilling parquert events on testnet and mainnet was failing due to missing events for validator txn type. Initially thought that events are missing b/c fullnode wasn't up to date. However, it wasn't the case. So, we are making a general rule that event_size_info will work for user_transactions, but no promisses on other transactions.
the new behavior is that if we don't have matching events and events_size_info, we are going to panic and investigate. But for other types, they will be defaulted to 0 size_info. for those txns with missing events that are not user_transactions, we can backfill anytime if needed.
humio log
Test Plan
Running locally aginast testnet endpoint with failing txn vesrion worked.