Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] In CSV parsing a date from a timestamp formatted column produces incorrect results #869

Closed
revans2 opened this issue Sep 28, 2020 · 1 comment
Labels
bug Something isn't working duplicate This issue or pull request already exists P2 Not required for release SQL part of the SQL/Dataframe plugin

Comments

@revans2
Copy link
Collaborator

revans2 commented Sep 28, 2020

Describe the bug
In the integration tests for csv test_basic_read for ts.csv when the schema says it should be a date produces results that cause an error when pulling them back to python because they are outside of the range that is supported by python, but the input year is 2020.

This was originally marked as #122 but that was recently fixed in cudf, but this issue remains.

@revans2 revans2 added bug Something isn't working ? - Needs Triage Need team to review and classify P2 Not required for release SQL part of the SQL/Dataframe plugin and removed ? - Needs Triage Need team to review and classify labels Sep 28, 2020
@sameerz sameerz added the duplicate This issue or pull request already exists label Nov 10, 2020
@sameerz
Copy link
Collaborator

sameerz commented Nov 10, 2020

This is a duplicate of issue #1091. We will keep that issue since it has more detail.

A side note, we need to update the documentation to refer to this issue.

@sameerz sameerz closed this as completed Nov 10, 2020
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this issue Nov 30, 2023
…IDIA#869)

Signed-off-by: spark-rapids automation <[email protected]>

Signed-off-by: spark-rapids automation <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working duplicate This issue or pull request already exists P2 Not required for release SQL part of the SQL/Dataframe plugin
Projects
None yet
Development

No branches or pull requests

2 participants