Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
  • Loading branch information
luongthanhanhduc committed May 18, 2017
2 parents a1a40a7 + 8951c20 commit 40c02bc
Show file tree
Hide file tree
Showing 132 changed files with 302 additions and 486 deletions.
28 changes: 28 additions & 0 deletions SQLFeatureExtraction/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,3 +3,31 @@ In order to produce the executable file *SQLComparison.jar* from Java source cod
mvn clean install

This command will install the maven project and create a executable jar file named *SQLComparison.jar* in the directory *SQLFeatureExtraction/target*

By running *SQLComparison.jar* with no options, user can reproduce feature vectors generated by:

(1) Each of the three similarity metrics (aligon, makiyama and aouiche);

(2) Under three different SQL log-like inputs (UB student exam, Bombay IIT and pocketdata-google+);

(3) With no further feature engineering;

(4) With each feature engineering module activated individually;

(5) With all feature engineering modules activated.

Options:

(1) User can specify a single input data set by using -input option. The available option parameters are: (1)ub; (2)bombay; (3)googleplus. (e.g. Java -jar SQLComparison.jar -input ub)

(2) User can specify a single similarity metric by using -metric option. The available option parameters are: (1)aligon; (2)makiyama; (3)aouiche. (e.g. Java -jar SQLComparison.jar -metric aligon)

(3) User can specify regularization modules to be activated by using -modules option. The available modules are: ID=1, Naming; ID=2, Expression Regularization; ID=3, From-Nesting Flattening; ID=4, UNION pull-out. User should specify corresponding IDs and use symbol "&" for combining multiple selected modules, if any. (e.g. Java -jar SQLComparison.jar -modules 1&2&3&4)

Result of running *SQLComparison.jar* will be saved to directory *SQLFeatureExtraction/data* and the result file naming format is: [input]+"_"+[metric]+ ".csv". If regularization is applied, naming format is: [input]+"_"+[metric]+"_regularization_"+[module IDs]+".csv"; If all modules of regularization are applied, naming format is simplified as: [input]+"_"+[metric]+"_regularization.csv".






4 changes: 2 additions & 2 deletions SQLFeatureExtraction/doc/Main.html
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:45 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Main</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="stylesheet.css" title="Style">
<script type="text/javascript" src="script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>CombinedRegularizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
4 changes: 2 additions & 2 deletions SQLFeatureExtraction/doc/Regularization/ContingentValue.html
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>ContingentValue</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
4 changes: 2 additions & 2 deletions SQLFeatureExtraction/doc/Regularization/DNFNormalizer.html
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>DNFNormalizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>DNFUNIONTransformer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>ExpressionRegularizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>FROMNestingCoalescer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>PlainSelectNamingResolver</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>PredicateNestingCoalescer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
12 changes: 6 additions & 6 deletions SQLFeatureExtraction/doc/Regularization/QueryToolBox.html
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>QueryToolBox</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down Expand Up @@ -249,9 +249,9 @@ <h3>Method Summary</h3>
</tr>
<tr id="i10" class="altColor">
<td class="colFirst"><code>static net.sf.jsqlparser.expression.Expression</code></td>
<td class="colLast"><code><span class="memberNameLink"><a href="../Regularization/QueryToolBox.html#parseUsing-java.util.List-net.sf.jsqlparser.statement.select.Join-net.sf.jsqlparser.statement.select.PlainSelect-">parseUsing</a></span>(java.util.List&lt;net.sf.jsqlparser.schema.Column&gt;&nbsp;clist,
<td class="colLast"><code><span class="memberNameLink"><a href="../Regularization/QueryToolBox.html#parseUsing-java.util.List-net.sf.jsqlparser.statement.select.Join-net.sf.jsqlparser.statement.select.FromItem-">parseUsing</a></span>(java.util.List&lt;net.sf.jsqlparser.schema.Column&gt;&nbsp;clist,
net.sf.jsqlparser.statement.select.Join&nbsp;j,
net.sf.jsqlparser.statement.select.PlainSelect&nbsp;ps)</code>
net.sf.jsqlparser.statement.select.FromItem&nbsp;leftSide)</code>
<div class="block">parse using expression</div>
</td>
</tr>
Expand Down Expand Up @@ -415,15 +415,15 @@ <h4>checkIfEvaluatedToNull</h4>
</dl>
</li>
</ul>
<a name="parseUsing-java.util.List-net.sf.jsqlparser.statement.select.Join-net.sf.jsqlparser.statement.select.PlainSelect-">
<a name="parseUsing-java.util.List-net.sf.jsqlparser.statement.select.Join-net.sf.jsqlparser.statement.select.FromItem-">
<!-- -->
</a>
<ul class="blockList">
<li class="blockList">
<h4>parseUsing</h4>
<pre>public static&nbsp;net.sf.jsqlparser.expression.Expression&nbsp;parseUsing(java.util.List&lt;net.sf.jsqlparser.schema.Column&gt;&nbsp;clist,
net.sf.jsqlparser.statement.select.Join&nbsp;j,
net.sf.jsqlparser.statement.select.PlainSelect&nbsp;ps)</pre>
net.sf.jsqlparser.statement.select.FromItem&nbsp;leftSide)</pre>
<div class="block">parse using expression</div>
<dl>
<dt><span class="paramLabel">Parameters:</span></dt>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>SelectBodyNamingResolver</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>SelectNamingResolver</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>TautologyRegularizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
4 changes: 2 additions & 2 deletions SQLFeatureExtraction/doc/Regularization/UNIONPULLer.html
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>UNIONPULLer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.CombinedRegularizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.ContingentValue</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.DNFNormalizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.DNFUNIONTransformer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.ExpressionRegularizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.FROMNestingCoalescer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.PlainSelectNamingResolver</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.PredicateNestingCoalescer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.QueryToolBox</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.SelectBodyNamingResolver</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.SelectNamingResolver</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.TautologyRegularizer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Uses of Class Regularization.UNIONPULLer</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../../stylesheet.css" title="Style">
<script type="text/javascript" src="../../script.js"></script>
</head>
Expand Down
4 changes: 2 additions & 2 deletions SQLFeatureExtraction/doc/Regularization/package-frame.html
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@
<!-- NewPage -->
<html lang="en">
<head>
<!-- Generated by javadoc (1.8.0_65) on Sun Feb 26 13:42:46 EST 2017 -->
<!-- Generated by javadoc (1.8.0_65) on Mon Mar 06 00:27:41 EST 2017 -->
<title>Regularization</title>
<meta name="date" content="2017-02-26">
<meta name="date" content="2017-03-06">
<link rel="stylesheet" type="text/css" href="../stylesheet.css" title="Style">
<script type="text/javascript" src="../script.js"></script>
</head>
Expand Down
Loading

0 comments on commit 40c02bc

Please sign in to comment.