-
Notifications
You must be signed in to change notification settings - Fork 0
/
results_report.txt
13 lines (13 loc) · 2.09 KB
/
results_report.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
model drop_dev tatqa_dev iirc_gold_dev iirc_gold_test iirc_retrieved_dev iirc_retrieved_test numglue_dev numglue_test drop_cs drop_bpb
0 bart-large 72.1 45.3 0.668 0.653 0.439 0.410 45.7 42.1 0.532 0.508
1 teabreac-bart-large 79.9 55.3 0.761 0.752 0.476 0.448 52.4 48.3 0.602 0.589
2 t5-large 76.3 46.8 0.680 0.637 0.453 0.389 49.1 42.7 0.531 0.560
3 teabreac-t5-large 81.5 58.6 0.725 0.727 0.460 0.455 53.2 49.6 0.600 0.625
4 t5-3b 81.9 50.2 0.704 0.681 0.460 0.399 54.6 49.4 0.616 0.634
5 teabreac-t5-3b 86.9 65.8 0.784 0.796 0.515 0.503 57.1 54.5 0.671 0.693
6 nt5-small 72.6 51.5 0.712 0.713 0.446 0.437 37.2 32.6 0.465 0.514
7 teabreac-nt5-small 74.9 53.0 0.704 0.703 0.446 0.436 50.6 47.4 0.533 0.535
8 preasm-large 80.1 48.7 0.744 0.735 0.455 0.409 51.5 46.4 0.573 0.558
9 teabreac-preasm-large 83.3 62.1 0.772 0.778 0.502 0.476 52.5 49.1 0.610 0.639
10 poet-large 79.7 53.4 0.719 0.737 0.469 0.443 49.7 45.6 0.583 0.552
11 teabreac-poet-large 82.0 56.0 0.762 0.759 0.486 0.465 51.6 49.9 0.637 0.603