Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip broken symlinks during calculation of digest (during fast registration) #2482

Merged
merged 3 commits into from
Jun 18, 2024

Conversation

eapolinario
Copy link
Collaborator

Why are the changes needed?

We had the erroneous assumption that all files are accessible during fast registration.

What changes were proposed in this pull request?

Verify that the file exists before trying to open it.

How was this patch tested?

Setup process

Screenshots

Check all the applicable boxes

  • I updated the documentation accordingly.
  • All new and existing tests passed.
  • All commits are signed-off.

Related PRs

Docs link

Signed-off-by: Eduardo Apolinario <[email protected]>
wild-endeavor
wild-endeavor previously approved these changes Jun 14, 2024
@@ -95,6 +95,9 @@ def compute_digest(source: os.PathLike, filter: Optional[callable] = None) -> st

for fname in files:
abspath = os.path.join(root, fname)
# Only consider files that exist (e.g. disregard symlinks that point to non-existent files)
if not os.path.exists(abspath):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we add an info line?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good call.

Signed-off-by: Eduardo Apolinario <[email protected]>
@eapolinario eapolinario merged commit f12cbd5 into master Jun 18, 2024
45 of 46 checks passed
bgedik pushed a commit to bgedik/flytekit that referenced this pull request Jul 3, 2024
…ration) (flyteorg#2482)

* Skip broken symlinks during calculation of digest (during fast registration)

Signed-off-by: Eduardo Apolinario <[email protected]>

* Put the check back

Signed-off-by: Eduardo Apolinario <[email protected]>

* Add log message

Signed-off-by: Eduardo Apolinario <[email protected]>

---------

Signed-off-by: Eduardo Apolinario <[email protected]>
Co-authored-by: Eduardo Apolinario <[email protected]>
Signed-off-by: bugra.gedik <[email protected]>
fiedlerNr9 pushed a commit that referenced this pull request Jul 25, 2024
…ration) (#2482)

* Skip broken symlinks during calculation of digest (during fast registration)

Signed-off-by: Eduardo Apolinario <[email protected]>

* Put the check back

Signed-off-by: Eduardo Apolinario <[email protected]>

* Add log message

Signed-off-by: Eduardo Apolinario <[email protected]>

---------

Signed-off-by: Eduardo Apolinario <[email protected]>
Co-authored-by: Eduardo Apolinario <[email protected]>
Signed-off-by: Jan Fiedler <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants