Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add tranche 2 parquet models #436

Closed
wants to merge 4 commits into from
Closed

Conversation

yuunlimm
Copy link
Contributor

Description

Adding parquet models for tranche 2 for the following tables:

  • fungible_asset_balances
  • signatures
  • coin_supply
  • objects
  • token_ownerships_v2
  • token_datas_v2
  • collections_v2
  • table_metadatas
  • move_modules
    ans_primary_name_v2

Test plan

This is just to get aligned on the model schemas, nothing to test yet.

@yuunlimm yuunlimm requested a review from ying-w June 28, 2024 19:47
pub is_primary: bool,
pub is_frozen: bool,
pub amount: u64,
pub transaction_timestamp: chrono::NaiveDateTime,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

transaction_timestamp -> block_timestamp

double check amount is u64 not u128

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@larry-aptos I think the question is more like this whether it's supposed to be u128 or u64

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@rtso the FA expert. what's the intended behavior for balances? like octa in integer right?

@yuunlimm yuunlimm force-pushed the yuunlimm/parquet-tranche2-models branch from 668ab74 to 09baec7 Compare July 2, 2024 23:21
@yuunlimm yuunlimm force-pushed the yuunlimm/parquet-tranche2-models branch from 09baec7 to ca7ae80 Compare July 2, 2024 23:25
@yuunlimm yuunlimm force-pushed the yuunlimm/parquet-tranche2-models branch 2 times, most recently from a8e218c to dc1e398 Compare July 3, 2024 18:20
@yuunlimm yuunlimm force-pushed the yuunlimm/parquet-tranche2-models branch from dc1e398 to 4248fbd Compare July 3, 2024 18:22
@yuunlimm yuunlimm requested a review from ying-w July 3, 2024 18:32
@ying-w ying-w requested a review from larry-aptos July 3, 2024 18:51
@@ -103,6 +107,7 @@ impl Transaction {
block_height: i64,
epoch: i64,
block_timestamp: chrono::NaiveDateTime,
txn_size_info: Option<&TransactionSizeInfo>,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lmk when you start backfill

use serde::{Deserialize, Serialize};

#[derive(
Allocative, Clone, Debug, Default, Deserialize, FieldCount, ParquetRecordWriter, Serialize,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is Deserialize and Serialize required?

@yuunlimm yuunlimm closed this Jul 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants