feat: create a backend to parse USPTO patents into DoclingDocument #606
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Merge ProtectionsYour pull request matches the following merge protections and will not be merged until they are valid. 🟢 Enforce conventional commitWonderful, this rule succeeded.Make sure that we follow https://www.conventionalcommits.org/en/v1.0.0/
🟢 Require two reviewer for test updatesWonderful, this rule succeeded.When test data is updated, we require two reviewers
|
3 tasks
ceberam
force-pushed
the
dev/xml-uspto
branch
from
122db98 to
174e7d8
Compare
ceberam
requested review from
PeterStaar-IBM,
dolfim-ibm and
cau-git
and removed request for
PeterStaar-IBM and
dolfim-ibm
ceberam
force-pushed
the
dev/xml-uspto
branch
from
dcfb2ae to
fe96c11
Compare
Signed-off-by: Cesar Berrospi Ramis <[email protected]>
Add a backend implementation to parse patent applications and grants from the United States Patent Office (USPTO). Signed-off-by: Cesar Berrospi Ramis <[email protected]>
Change the name of the patent USPTO input format to show the typical format (XML). Signed-off-by: Cesar Berrospi Ramis <[email protected]>
Signed-off-by: Cesar Berrospi Ramis <[email protected]>
ceberam
force-pushed
the
dev/xml-uspto
branch
from
fe96c11 to
3d249eb
Compare
Signed-off-by: Cesar Berrospi Ramis <[email protected]>
Signed-off-by: Cesar Berrospi Ramis <[email protected]>
ceberam
force-pushed
the
dev/xml-uspto
branch
from
3d249eb to
94735ec
Compare
dolfim-ibm
approved these changes
Dec 17, 2024
cau-git
approved these changes
Dec 17, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Resolves #605
This PR implements the following changes:
docling/datamodel/document.pyto address the scenario of multipleInputFormatinstances with the same mime type. In particular, add a function that further examines part of an input document to guess theInputFormatinstance to use for the conversion.This PR is intended to be merged after #557
Checklist:
Limitations:
The following points will need to be addressed in later PRs:
guess_formatfunction indocling/datamodel/document.pymodule, once we support another XML InputFormat, sinceapplication/xmlmime type will already be ambiguous.abstract_bakend.pythat examines a partial content of a document and determines if the backend implementation supports a document type with that content. This function could then be called indocling/datamodel/document.pymodule and avoid duplicated code when disambiguating mime types.text/plainbackend parser.