Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Orc merge schema fallback and FileScan format configs #158

Merged
merged 3 commits into from
Jun 12, 2020
Merged

Orc merge schema fallback and FileScan format configs #158

merged 3 commits into from
Jun 12, 2020

Conversation

revans2
Copy link
Collaborator

@revans2 revans2 commented Jun 11, 2020

This fixes #61 and #106
It puts in a mitigation for #135 but does not actually fix it.

@revans2
Copy link
Collaborator Author

revans2 commented Jun 11, 2020

build

3 similar comments
@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

3 similar comments
@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

1 similar comment
@revans2
Copy link
Collaborator Author

revans2 commented Jun 12, 2020

build

@revans2 revans2 self-assigned this Jun 12, 2020
@revans2 revans2 merged commit ed91f73 into NVIDIA:branch-0.1 Jun 12, 2020
@sameerz sameerz added feature request New feature or request bug Something isn't working and removed feature request New feature or request labels Jun 15, 2020
@sameerz sameerz added this to the Jun 8 - Jun 19 milestone Jun 16, 2020
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* disable merge schema for orc reads

* Added in configs to disable various file formats

* Added in tests
nartal1 pushed a commit to nartal1/spark-rapids that referenced this pull request Jun 9, 2021
* disable merge schema for orc reads

* Added in configs to disable various file formats

* Added in tests
tgravescs pushed a commit to tgravescs/spark-rapids that referenced this pull request Nov 30, 2023
Signed-off-by: spark-rapids automation <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Cannot disable Parquet, ORC, CSV reading when using FileSourceScanExec
3 participants