-
Notifications
You must be signed in to change notification settings - Fork 0
/
cross_validation_results.txt
139 lines (118 loc) · 4.62 KB
/
cross_validation_results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
For k = 2:
---------------------------------------------
i = 1
CRFClassifier tagged 24880 words in 1381 documents at 9539.88 words per second.
Entity P R F1 TP FP FN
LOC 0.8811 0.4614 0.6056 215 29 251
MISC 0.5294 0.0744 0.1304 9 8 112
ORG 0.7077 0.2893 0.4107 92 38 226
PER 0.7158 0.7082 0.7120 529 210 218
Totals 0.7478 0.5115 0.6075 845 285 807
i = 2
CRFClassifier tagged 24826 words in 1435 documents at 10116.54 words per second.
Entity P R F1 TP FP FN
LOC 0.5317 0.4621 0.4945 67 59 78
MISC 0.5714 0.0721 0.1280 8 6 103
ORG 0.6364 0.2655 0.3747 77 44 213
PER 0.8349 0.7464 0.7881 718 142 244
Totals 0.7761 0.5769 0.6618 870 251 638
Precision : 0.7620 (0.76195)
Recall : 0.5442
F-1 : 0.6347 (0.63465)
with maxNGramLeng=6
P: 75.212947189
R: 56.03994194
F-1: 64.193467182
with #maxNGramLeng=6
P: 75.35122344292401
R: 55.9736289426529
F1: 64.19833656954505
For k = 10:
---------------------------------------------
i = 1
CRFClassifier tagged 4977 words in 275 documents at 7019.75 words per second.
Entity P R F1 TP FP FN
LOC 0.9341 0.6641 0.7763 85 6 43
MISC 0.8000 0.1481 0.2500 4 1 23
ORG 0.7917 0.4368 0.5630 38 10 49
PER 0.6279 0.5567 0.5902 54 32 43
Totals 0.7870 0.5339 0.6362 181 49 158
i = 2
CRFClassifier tagged 4988 words in 264 documents at 9446.97 words per second.
Entity P R F1 TP FP FN
LOC 0.8468 0.7460 0.7932 94 17 32
MISC 0.9000 0.2903 0.4390 9 1 22
ORG 0.7925 0.5600 0.6563 42 11 33
PER 0.7244 0.7077 0.7160 92 35 38
Totals 0.7874 0.6547 0.7149 237 64 125
i = 3
CRFClassifier tagged 4983 words in 269 documents at 10602.13 words per second.
Entity P R F1 TP FP FN
LOC 0.8739 0.7348 0.7984 97 14 35
MISC 0.0000 0.0000 0.0000 0 4 16
ORG 0.9750 0.5417 0.6964 39 1 33
PER 0.7838 0.6744 0.7250 87 24 42
Totals 0.8383 0.6390 0.7252 223 43 126
i = 4
CRFClassifier tagged 4975 words in 277 documents at 6008.45 words per second.
Entity P R F1 TP FP FN
LOC 0.6897 0.5263 0.5970 20 9 18
MISC 0.5000 0.0833 0.1429 2 2 22
ORG 0.7727 0.3953 0.5231 17 5 26
PER 0.8086 0.7401 0.7729 131 31 46
Totals 0.7834 0.6028 0.6814 170 47 112
i = 5
CRFClassifier tagged 4952 words in 299 documents at 9963.78 words per second.
Entity P R F1 TP FP FN
LOC 0.8182 0.4286 0.5625 18 4 24
MISC 0.5833 0.3043 0.4000 7 5 16
ORG 0.8182 0.4390 0.5714 18 4 23
PER 0.8140 0.8178 0.8159 175 40 39
Totals 0.8044 0.6813 0.7377 218 53 102
i = 6
CRFClassifier tagged 4959 words in 293 documents at 9000.00 words per second.
Entity P R F1 TP FP FN
LOC 0.7308 0.6333 0.6786 19 7 11
MISC 0.7500 0.1935 0.3077 6 2 25
ORG 0.5000 0.2535 0.3364 18 18 53
PER 0.7946 0.8128 0.8036 178 46 41
Totals 0.7517 0.6296 0.6853 221 73 130
i = 7
CRFClassifier tagged 4983 words in 269 documents at 6404.88 words per second.
Entity P R F1 TP FP FN
LOC 0.5556 0.3571 0.4348 10 8 18
MISC 0.2500 0.0476 0.0800 1 3 20
ORG 0.7353 0.4386 0.5495 25 9 32
PER 0.8359 0.6948 0.7589 107 21 47
Totals 0.7772 0.5500 0.6441 143 41 117
i = 8
CRFClassifier tagged 4970 words in 282 documents at 10688.17 words per second.
Entity P R F1 TP FP FN
LOC 0.7857 0.5946 0.6769 22 6 15
MISC 0.3333 0.1538 0.2105 2 4 11
ORG 0.5833 0.3889 0.4667 21 15 33
PER 0.8624 0.8393 0.8507 188 30 36
Totals 0.8090 0.7104 0.7565 233 55 95
i = 9
CRFClassifier tagged 4962 words in 290 documents at 10740.26 words per second.
Entity P R F1 TP FP FN
LOC 0.6190 0.4483 0.5200 13 8 16
MISC 0.6000 0.2609 0.3636 6 4 17
ORG 0.7500 0.2632 0.3896 15 5 42
PER 0.8495 0.8634 0.8564 158 28 25
Totals 0.8101 0.6575 0.7259 192 45 100
i = 10
CRFClassifier tagged 4948 words in 304 documents at 9515.38 words per second.
Entity P R F1 TP FP FN
LOC 0.3000 0.2857 0.2927 6 14 15
MISC 1.0000 0.0435 0.0833 1 0 22
ORG 0.6842 0.2549 0.3714 13 6 38
PER 0.8258 0.8077 0.8167 147 31 35
Totals 0.7661 0.6029 0.6747 167 51 110
Precision : 0.7915 (0.79146)
Recall : 0.6262 (0.62621)
F-1 : 0.6982 (0.69819)
with #maxNGramLeng=6
P: 78.1614580285334
R: 63.62216586095117
F1: 70.05550314245735