Skip to content

chitranshi21/webCrawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is a basic Webcrawler.

How to Run -->
1) make sure you have all the dependencies in place. 
    a) Jsoup(1.8.2) - for URL handeling
    b) Gson(2.2.4) - To convert to json format.
    c) apache common validator(1.4.1) - to validate the url

2) Compile WebCrawler.java --> javac WebCrawler.java 

3) Run WebCrawler with following arguments
    1) start url (Optional)
    2) Number of Hops (Optional)
    3) Output format (Optional)

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages