Skip to content

Latest commit

 

History

History
31 lines (16 loc) · 865 Bytes

README.md

File metadata and controls

31 lines (16 loc) · 865 Bytes

TPOT Facebook Scraper 🐫

Goals 📆

TODOs 🎱

  • Solve the need for calling the client regularly by:
    • a) finding a library that can diff html files
    • b) save the diffs to a column in the DB, for later reconstruction and backtracking.
  • Once the first round of html is saved, call the API to create a new row with the html
  • [ ]

Ideas

Scrapy Spiders

  1. Just rent cheap virtual cloud based server at Digital Ocean (or any other provider) and use cron to schedule your jobs

    Where to deploy scrapers

    Best Answer?

  2. Scrapy Providers

Try Ionic for Mobile deployments

  1. Ionic Documentation