-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add special handling for multiple trailing slashes in the parent directory #18155
Add special handling for multiple trailing slashes in the parent directory #18155
Conversation
f8aaac5
to
e6ad76f
Compare
i am not great fan of this special handling / inconsistency:
Clearly
if the only fix possible would be modifying the If we want to fix this, I would look what it takes to support this on connector level. |
What if we return consistently a '/' at the end of the parent directory actually?
I'm fine with abandoning at the moment the current PR and disallowing on the Delta Lake connector
cc @electrum |
i agree it's faulty and propose to throw for |
I'm confused about the problem being solved here. The stack trace in the linked issue is using the deprecated
This seems like the best behavior, as it will work consistently in both scenarios. It will break the behavior of
An issue with the current behavior of stripping the trailing slash is that
Consistently returning a slash will result in the following, which seems better:
|
Thank you for the feedback. I'll create a new PR based on the feedback from #17966 (comment) |
Description
AWS S3 object storage provider allows paths containing multiple trailing slashes
s3://bucket/path/directory//
This leads to the situation where a file with the following location
s3://bucket/path/directory//file
would have the parent
s3://bucket/path/directory//
This PR adds special handling in retrieving the parent directory for a file in case it contains trailing slashes.
Fixes #17966
Additional context and related issues
Release notes
(x) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( ) Release notes are required, with the following suggested text: