Skip to content
This repository has been archived by the owner on Aug 31, 2024. It is now read-only.
/ carcrawler Public archive

Find the best deal on your second hand dream car by crawling multiple carsites and displaying the results in a graph to instantly spot good deal

Notifications You must be signed in to change notification settings

gerard76/carcrawler

Repository files navigation

Depricated and outdated

Old, unloved and depricated.

Kimurai is no longer maintained. The car sites all updated their HTML so the scrapers no longer work. I'll create a new project to look for my next car

README

Carcrawler is a friendly webscraper I wrote to find the car I want for the best price.

It currently supports 4 car sites and stores the result in a Postgresql database. It uses Kimurai (https://github.com/vifreefly/kimuraframework) for the crawling.

Install webdrivers for Kimurai:

OSX: brew cask install google-chrome brew cask install chromedriver

other: see https://github.com/vifreefly/kimuraframework

Database

Results are stored in a database. I use Postgresql, but change Gemfile and database.yml if you want something else.

Crawl

You do need to change the starting urls for each of the supported car sites to make it look for the car you want. Crawler.crawl!

Results

Start your Rails server: rails s

http://localhost:3000 will serve up a nice chart

BMW i3 graph

About

Find the best deal on your second hand dream car by crawling multiple carsites and displaying the results in a graph to instantly spot good deal

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published