Simple web crawler script using recursion and puppeteer.
Instructions:
- run
yarnornpm install - Configure .env file (see .env_example)
- URL is required
- DEPTH is not required but suggested
- PROXY is not required
- run
yarn startornpm start
Simple web crawler script using recursion and puppeteer.
Instructions:
yarn or npm installyarn start or npm start