Skip to content

Commit

Permalink
[pre-commit.ci] auto fixes from pre-commit.com hooks
Browse files Browse the repository at this point in the history
for more information, see https://pre-commit.ci
  • Loading branch information
pre-commit-ci[bot] committed Jun 11, 2024
1 parent 689b48f commit d14a6bc
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions comps/guardrails/pii_detection/ray_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -36,9 +36,7 @@ def _read_stream(self, f: "pyarrow.NativeFile", path: str) -> Iterator[Block]:

def rayds_initialization(file_paths, dataloader_callable, lazy_mode=True, num_cpus=20):
if dataloader_callable is None:
text_list = [
{"data": data, "filename": data[:50], "error": None, "read_time": "0 secs"} for data in file_paths
]
text_list = [{"data": data, "filename": data[:50], "error": None, "read_time": "0 secs"} for data in file_paths]
return ray.data.from_items(text_list)

decorated_dataloader_callable = get_failable_with_time(dataloader_callable)
Expand Down

0 comments on commit d14a6bc

Please sign in to comment.