chore: add boilerpy3 to the core dependencies

[masci]

Related Issues

The additional pip install boilerpy3 is ubiquitous in our docs and code examples, let's just make it part of haystack-ai

Proposed Changes:

Add boilerpy3 as a dependency, it's only 22kb

How did you test it?

Notes for the reviewer

Checklist

• I have read the contributors guidelines and the code of conduct
• I have updated the related issue with new insights and changes
• I added unit tests and updated the docstrings
• I've used one of the conventional commit types for my PR title: fix:, feat:, build:, chore:, ci:, docs:, style:, refactor:, perf:, test:.
• I documented my code
• I ran pre-commit hooks and fixed any issue

[anakin87]

Sorry to jump in... (this is also related to my work on Converters)

Can you also remove boilerpy3 from tests workflow?

[julian-risch]

Just saw the same :D Here is my link:

haystack/.github/workflows/tests.yml

Line 101 in 8d9c3de

run: pip install .[dev,audio] langdetect transformers[torch,sentencepiece]==4.35.2 'sentence-transformers>=2.2.0' pypdf markdown-it-py mdit_plain tika 'azure-ai-formrecognizer>=3.2.0b2' boilerpy3

[julian-risch]

LGTM! 👍 Just the release note check is failing. And the linter complained:

haystack/components/converters/html.py:9:0: C0411: third party import "from boilerpy3 import extractors" should be placed before "from haystack import Document, component" (wrong-import-order)
haystack/components/converters/html.py:7:0: W0611: Unused LazyImport imported from haystack.lazy_imports (unused-import)

Once this is merged and we released a new Haystack version, we can remove the boilerpy3 installation from "Advent of Haystack: Day 10" challenge.