Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch processing #13

Merged
merged 21 commits into from
Feb 18, 2024
Merged

Batch processing #13

merged 21 commits into from
Feb 18, 2024

Conversation

pszemraj
Copy link
Owner

this PR contains some more behind-the-scenes improvements related to ease-of-use and/or batch processing for the Summarizer class object:

  • disable the progress bar for within-loop summarization of a single long string
  • add a 'smart' __call__ function that hands off to the text and filepath processing fns
  • small improvements/updates to docs

Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
@pszemraj pszemraj added the enhancement New feature or request label Feb 17, 2024
@pszemraj pszemraj self-assigned this Feb 17, 2024
@pszemraj
Copy link
Owner Author

pszemraj commented Feb 17, 2024

todo:

  • check/test that the default-disabled autocast doesnt break anything
  • add a batch_delimiter (or similar) kwarg for setting the join string for output of summarize_string()

Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
Signed-off-by: peter szemraj <[email protected]>
@pszemraj pszemraj merged commit 82bafca into main Feb 18, 2024
@pszemraj pszemraj deleted the batch-processing branch February 18, 2024 19:18
@pszemraj pszemraj restored the batch-processing branch February 18, 2024 19:18
@pszemraj pszemraj deleted the batch-processing branch February 18, 2024 19:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant