Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] nested column names of a cuDF dataframe created by read_orc are not printed #8963

Closed
vuule opened this issue Aug 5, 2021 · 2 comments · Fixed by #10042
Closed

[BUG] nested column names of a cuDF dataframe created by read_orc are not printed #8963

vuule opened this issue Aug 5, 2021 · 2 comments · Fixed by #10042
Assignees
Labels
bug Something isn't working cuIO cuIO issue Python Affects Python cuDF API.

Comments

@vuule
Copy link
Contributor

vuule commented Aug 5, 2021

The names are not present when printing the cuDF dataframe, even though the names are in the read_orc output. Moreover, the names are present when the dataframe is cast to pandas.

Using the input from #8910:

def test_orc_names(datadir):
    path = "struct_orc.log"
    gdf = cudf.read_orc(path)
    pdf = pd.read_orc(path)

    print(gdf)
    print(gdf.to_pandas())
             a            b                    s1                          s2
0    326215455    964670395   {'0': 2056831253.0}  {'0': {'0': 1140062029.0}}
1    326215455  -1123177776   {'0': 1735783038.0}                        None
2    326215455         <NA>   {'0': -335532064.0}  {'0': {'0': 1998862860.0}}
3    326215455   -656685553  {'0': -1463792165.0}                 {'0': None}
4    326215455  -1943088595   {'0': 1762505979.0}  {'0': {'0': -521321651.0}}
..         ...          ...                   ...                         ...
995  289956431   1954977719  {'0': -1219859255.0}  {'0': {'0': 2013006809.0}}
996  289956431  -1028878225   {'0': 1139661239.0}   {'0': {'0': 908256279.0}}
997  289956431   1827136073    {'0': 871691692.0}                        None
998  289956431   2147483647    {'0': 720591207.0}  {'0': {'0': 1773585916.0}}
999  289956431   -122306082                  None  {'0': {'0': 1801980339.0}}
[1000 rows x 4 columns]
               a  ...                             s2
0    326215455.0  ...  {'sa': {'ssa': 1140062029.0}}
1    326215455.0  ...                           None
2    326215455.0  ...  {'sa': {'ssa': 1998862860.0}}
3    326215455.0  ...                   {'sa': None}
4    326215455.0  ...  {'sa': {'ssa': -521321651.0}}
..           ...  ...                            ...
995  289956431.0  ...  {'sa': {'ssa': 2013006809.0}}
996  289956431.0  ...   {'sa': {'ssa': 908256279.0}}
997  289956431.0  ...                           None
998  289956431.0  ...  {'sa': {'ssa': 1773585916.0}}
999  289956431.0  ...  {'sa': {'ssa': 1801980339.0}}
@vuule vuule added bug Something isn't working Needs Triage Need team to review and classify Python Affects Python cuDF API. cuIO cuIO issue labels Aug 5, 2021
@galipremsagar galipremsagar self-assigned this Aug 5, 2021
@vuule vuule removed the Needs Triage Need team to review and classify label Aug 5, 2021
@github-actions
Copy link

This issue has been labeled inactive-90d due to no recent activity in the past 90 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed.

@github-actions
Copy link

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.

rapids-bot bot pushed a commit that referenced this issue Jan 14, 2022
Fixes: #8963 

This PR fixes a trivial issue in `concat` where the assumption was that `_with_type_metadata` is an in-place operation, but it isn't.

Authors:
  - GALI PREM SAGAR (https://github.com/galipremsagar)
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Vyas Ramasubramani (https://github.com/vyasr)
  - Bradley Dice (https://github.com/bdice)

URL: #10042
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working cuIO cuIO issue Python Affects Python cuDF API.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants