A workaway.info paginated crawler for better organizing your search results. Express on the backend and React + Redux + Material UI for the frontend

TODO

• Dynamic crawling with regions as a parameter
• Archive, favorite actions
• Display excerpt
• "Load more" when scrolling

Prerequisites

$ pip install scrapy pymongo
$ brew update && brew install node mongodb

1. Start your MongoDB service

$ cd / && mongod

2. Do your first crawl

$ cd workaway && scrapy crawl works

Run

$ npm i && npm run dev