Skip to content

Commit

Permalink
Fix remote path check for UC volumes
Browse files Browse the repository at this point in the history
  • Loading branch information
irenedea committed Dec 19, 2023
1 parent 06b9a1f commit b18da2b
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions scripts/data_prep/convert_text_to_mds.py
Original file line number Diff line number Diff line change
Expand Up @@ -256,8 +256,8 @@ def is_remote_path(path: str) -> bool:
Args:
path (str): path to check
"""
backend, bucket, _ = parse_uri(path)
return backend != '' and bucket != ''
backend, _, _ = parse_uri(path)
return backend != ''


def is_already_processed(output_root: str, args_str: str,
Expand Down

0 comments on commit b18da2b

Please sign in to comment.