Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ARROW-3448: [Python] Add test for roundtrip of pandas DataFrame with column of lists of datetime objects #10866

Closed
wants to merge 1 commit into from

Conversation

kszucs
Copy link
Member

@kszucs kszucs commented Aug 4, 2021

The issue has been already resolved, just updating the test examples.

@kszucs kszucs requested a review from pitrou August 4, 2021 13:37
@github-actions
Copy link

github-actions bot commented Aug 4, 2021

Copy link
Member

@jorisvandenbossche jorisvandenbossche left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's fine to add a test for this, but as I mentioned on the JIRA, this doesn't actually "fix" what's described in the title of the PR.

(pa.timestamp('s'), datetime_data),
(pa.timestamp('ms'), datetime_data),
(pa.timestamp('us'), datetime_data),
(pa.timestamp('ns'), pandas_timestamp_data),
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you get an error when you pass datetime_data here? (there are no nanoseconds here, so I would expect this to not matter)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes:

E   AssertionError: DataFrame.iloc[:, 12] (column name="timestamp[ns]_list") are different
E
E   DataFrame.iloc[:, 12] (column name="timestamp[ns]_list") values are different (80.0 %)
E   [index]: [0, 1, 2, 3, 4]
E   [left]:  [[2015-01-05T12:00:00.000000000, 2020-08-22T10:05:00.000000000], [2024-05-05T05:49:01.000000000, 2015-12-24T22:10:17.000000000], [1996-04-30T02:38:11.000000000], None, [1987-01-27T08:21:59.000000000, NaT]]
E   [right]: [[2015-01-05 12:00:00, 2020-08-22 10:05:00], [2024-05-05 05:49:01, 2015-12-24 22:10:17], [1996-04-30 02:38:11], None, [1987-01-27 08:21:59, None]]

@jorisvandenbossche jorisvandenbossche changed the title ARROW-3448: [Python] Pandas roundtrip doesn't preserve list of datetime objects ARROW-3448: [Python] Add test for roundtrip of pandas DataFrame with column of lists of datetime objects Aug 4, 2021
@pitrou
Copy link
Member

pitrou commented May 4, 2022

@jorisvandenbossche @kszucs What is the status of this PR? Should it be revived or closed?

@kszucs
Copy link
Member Author

kszucs commented May 4, 2022

We can close this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants