Skip to content

Commit

Permalink
Wait a bit longer for responses to come in
Browse files Browse the repository at this point in the history
  • Loading branch information
simoncozens committed Sep 9, 2024
1 parent 00b1637 commit 9534664
Showing 1 changed file with 3 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -84,6 +84,9 @@ def parse_data(self, page: str, **kwargs) -> dict:
)
)

# Even then it can still be adding data to the page...
time.sleep(2)

soup = BeautifulSoup(driver.page_source, features="html.parser")
# This is ugly but there is literally no consistency to the HTML
def is_a_collection_date(t):
Expand Down

0 comments on commit 9534664

Please sign in to comment.