Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhancement: partitoin_pdf() skip unnecessary element sorting #3030

Merged
merged 8 commits into from
May 16, 2024

Conversation

christinestraub
Copy link
Collaborator

@christinestraub christinestraub commented May 15, 2024

This PR aims to skip element sorting when determining whether embedded text can be extracted. The extracted elements in this step are returned as final elements only for the fast strategy pipeline and are never used for other strategy pipelines (hi_res, ocr).
Removing element sorting in this step and adding it to the fast strategy pipeline later will improve performance and reduce execution time.

Summary

  • skip element sorting when determining whether embedded text can be extracted.
  • add _partition_pdf_with_pdfparser() function for fast` strategy pipeline

Testing

CI should pass.

@christinestraub christinestraub changed the title enhancement: partitoin_pdf() skip unnecessary embedded text sorting enhancement: partitoin_pdf() skip unnecessary element sorting May 15, 2024
@christinestraub christinestraub added this pull request to the merge queue May 16, 2024
Merged via the queue into main with commit 1fb0fe5 May 16, 2024
42 checks passed
@christinestraub christinestraub deleted the feat/pdf-skip-unnecessary-embedded-text-sorting branch May 16, 2024 06:31
github-merge-queue bot pushed a commit that referenced this pull request May 17, 2024
…eline (#3040)

This PR aims to pass `kwargs` through `fast` strategy pipeline, which
was missing as part of the previous PR -
#3030.
I also did some code refactoring in this PR, so I recommend reviewing
this PR commit by commit.

### Summary
- pass `kwargs` through `fast` strategy pipeline, which will allow users
to specify additional params like `sort_mode`
- refactor: code reorganization
- cut a release for `0.14.0`
### Testing
CI should pass
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants