Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Utilise struct stats when available #656

Merged
merged 42 commits into from
Jul 6, 2022
Merged

Utilise struct stats when available #656

merged 42 commits into from
Jul 6, 2022

Commits on Jun 19, 2022

  1. Log stats

    @Tom-Newton
    Tom-Newton committed Jun 19, 2022
    Configuration menu
    Copy the full SHA
    e8be31b View commit details
    Browse the repository at this point in the history

  2. Point unittest to problematic data

    @Tom-Newton
    Tom-Newton committed Jun 19, 2022
    Configuration menu
    Copy the full SHA
    89a25ae View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2022

  1. Add minimal test data to reproduce

    @Tom-Newton
    Tom-Newton committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    1f2f023 View commit details
    Browse the repository at this point in the history

  2. Update test data

    @Tom-Newton
    Tom-Newton committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    c1c17b5 View commit details
    Browse the repository at this point in the history

  3. Fix test data

    @Tom-Newton
    Tom-Newton committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    96b508b View commit details
    Browse the repository at this point in the history

  4. Add test

    @Tom-Newton
    Tom-Newton committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    0c38cc8 View commit details
    Browse the repository at this point in the history

  5. Update rust logging

    @Tom-Newton
    Tom-Newton committed Jun 20, 2022
    Configuration menu
    Copy the full SHA
    e37486f View commit details
    Browse the repository at this point in the history

Commits on Jun 22, 2022

  1. It actually compiles!

    @Tom-Newton
    Tom-Newton committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    a482b84 View commit details
    Browse the repository at this point in the history

  2. I don't understand rust

    @Tom-Newton
    Tom-Newton committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    7eb031c View commit details
    Browse the repository at this point in the history

  3. Debug logging

    @Tom-Newton
    Tom-Newton committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    9af132a View commit details
    Browse the repository at this point in the history

  4. Fix sample data

    @Tom-Newton
    Tom-Newton committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    a5172e4 View commit details
    Browse the repository at this point in the history

  5. Tidy

    @Tom-Newton
    Tom-Newton committed Jun 22, 2022
    Configuration menu
    Copy the full SHA
    d5bf0da View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2022

  1. Update rust/src/action.rs 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 23, 2022
    Configuration menu
    Copy the full SHA
    514c7cd View commit details
    Browse the repository at this point in the history

  2. Test data with more complex types

    @Tom-Newton
    Tom-Newton committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    e3a3be1 View commit details
    Browse the repository at this point in the history

  3. Still return json stats if there is an error parsing parquet stats

    @Tom-Newton
    Tom-Newton committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    1a78ccd View commit details
    Browse the repository at this point in the history

  4. Better error message

    @Tom-Newton
    Tom-Newton committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    5af9a3a View commit details
    Browse the repository at this point in the history

  5. Unittest covering more complex types

    @Tom-Newton
    Tom-Newton committed Jun 23, 2022
    Configuration menu
    Copy the full SHA
    eba1a1d View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2022

  1. Support parsing structs

    @Tom-Newton
    Tom-Newton committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    94a007b View commit details
    Browse the repository at this point in the history

  2. Compare struct comes out the same as json

    @Tom-Newton
    Tom-Newton committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    46098e7 View commit details
    Browse the repository at this point in the history

  3. Correct timestamp formatting

    @Tom-Newton
    Tom-Newton committed Jun 24, 2022
    Configuration menu
    Copy the full SHA
    183d131 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2022

  1. In progress better test and support for more columns

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    957c8b5 View commit details
    Browse the repository at this point in the history

  2. All types except decimal work

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    c145585 View commit details
    Browse the repository at this point in the history

  3. Test data with nested structs

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    bee0d15 View commit details
    Browse the repository at this point in the history

  4. Update test

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    bc8128a View commit details
    Browse the repository at this point in the history

  5. All workng except decimal

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    c2887d9 View commit details
    Browse the repository at this point in the history

  6. Working decimal conversion

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    f82b6c9 View commit details
    Browse the repository at this point in the history

  7. Update test data again

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    2d3865c View commit details
    Browse the repository at this point in the history

  8. Passing test

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    8e5efac View commit details
    Browse the repository at this point in the history

  9. Tidy

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    5b006f1 View commit details
    Browse the repository at this point in the history

  10. Tidy

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    33a02c5 View commit details
    Browse the repository at this point in the history

  11. Tidy

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    9bea24a View commit details
    Browse the repository at this point in the history

  12. Remove .crc files

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    352e3d5 View commit details
    Browse the repository at this point in the history

  13. Merge remote-tracking branch 'upstream2/main' into tomnewton/utilise_… 

    …struct_stats_when_available
    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    0441169 View commit details
    Browse the repository at this point in the history

  14. Remove unneeded return statements

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    8d9ca72 View commit details
    Browse the repository at this point in the history

  15. Remove python test

    @Tom-Newton
    Tom-Newton committed Jun 26, 2022
    Configuration menu
    Copy the full SHA
    9ff8219 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. Use from and reference instead of clone 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    a1571e6 View commit details
    Browse the repository at this point in the history

  2. Use into 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    5e845cc View commit details
    Browse the repository at this point in the history

  3. dereferance timestamp 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    a2c5733 View commit details
    Browse the repository at this point in the history

  4. use into 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    70f8cee View commit details
    Browse the repository at this point in the history

  5. Use reference to field 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    da132ee View commit details
    Browse the repository at this point in the history

  6. de-reference date 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    d0d8d5f View commit details
    Browse the repository at this point in the history

  7. Update rust/tests/read_delta_test.rs 

    Co-authored-by: Will Jones <[email protected]>
    @Tom-Newton @wjones127
    Tom-Newton and wjones127 authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    270b027 View commit details
    Browse the repository at this point in the history