Basic Web Crawling Scrapy Selenium Scrapy + Selenium Prerequisites Python python -m venv venv source venv/bin/activate pip install -r requirements.txt optional use Brave Browser for smoother Selenium