Update scraper after markup of source website changed

The markup of the OEIL has changed and the previous selector to extract the procedure title didn’t work any more. Also updated the tests fixture with the current version of the web page.
HowTheyVote · Nov 14, 2024 · 2bcafab · 2bcafab
1 parent 377c566
commit 2bcafab
Show file tree

Hide file tree

Showing 2 changed files with 2,343 additions and 3,290 deletions.
diff --git a/backend/howtheyvote/scrapers/votes.py b/backend/howtheyvote/scrapers/votes.py
@@ -424,7 +424,7 @@ def _extract_data(self, doc: BeautifulSoup) -> Fragment:
         )
 
     def _title(self, doc: BeautifulSoup) -> str | None:
-        title = doc.select_one("#procedure-file-header .ep-layout_underline")
+        title = doc.select_one("#website-body h2.erpl_title-h2")
 
         if not title:
             return None