Skip to content

Latest commit

 

History

History
35 lines (19 loc) · 1.73 KB

Readme.md

File metadata and controls

35 lines (19 loc) · 1.73 KB

CVPR papers pretty html

This is a set of scripts for creating nice preview page (see here: http://www.colinlea.com/guides/cvpr2013 ) for all papers published at CVPR. I hope these scripts can be useful to others to create similar pages for other conferences. They show how one can manipulate PDFs, extract image thumbnails, analyze word frequencies, do AJAX requests to load abstracts, etc.

Installation

  1. Clone this repository git clone https://github.com/colincsl/cvpr2013papers.git

  2. Make sure you have the following libraries [System: ghostscript, imagemagick; Python: httplib2, beautifulsoup]

On OSX: brew install ghostscript brew install imagemagick pip install httplib2 pip install beautifulsoup

  1. Download CVPR papers using download_cvpr2013.py and put them into the folder papers/

  2. Run pdftowordcloud.py (to generate top words for each paper. Output saved in topwords.p as pickle)

  3. Run pdftothumbs.py (to generate tiny thumbnails for all papers. Outputs saved in thumbs/ folder)

  4. Run scrape_cvpr2013.py (to generate paperid, title, authors list by scraping NIPS .html page)

  5. Run makecorpus.py (to create allpapers.txt file that has all papers one per row)

  6. Run python lda.py -f allpapers.txt -k 7 --alpha=0.5 --beta=0.5 -i 100 . This will generate a pickle file called ldaphi.p that contains the LDA word distribution matrix. Thanks to this nice LDA code by shuyo! It requires nltk library and numpy. In this example we are using 7 categories. You would need to change the website_template.html file a bit if you wanted to try different number of categories.

  7. Finally, run generatenicelda.py (to create the nipsnice.html page)

Licence

WTFPL licence