Bigram Generator

Short Description :

Bigram Generator is a java class that is used to extract bigrams from a Lucene index and calculate their scores .
It outputs : (bigramID - bigram - term1(frequency) - term2(frequency) - bigram frequency - bigram score).
The score is calculated based on Mutual Information formula from the following book :
https://www.cs.vassar.edu/~cs366/docs/Manning_Schuetze_StatisticalNLP.pdf
Browser Page (206) - Paper Page (178)
It is developed as a part of Lucene4IR

Process Schema :

This is the workflow (Process schema) of the application :

Steps 1 and 2 ( Creating the index perferraly using AppIndexer from Lucene4IR )
Steps (3 and 4) show the work of the Generator

Usage :

in order to use the class , do the following :

Create Index
Place parameter XML File
Fill parameters in XML File
Run