This table is now outdated. Up-to-date version: https://docs.google.com/spreadsheets/d/1j8DFWzQ7sWdGvdy5R9hILb1rGMAESGVzQojF4CyQnfA/edit?usp=sharing
As outlined on http://elitr.eu/scope, ELITR needs to cover all EU and about 20 other languages, the official languages of EUROSAI member countries.
The following table lists all the languages jointly with their coverage in InterCorp (https://intercorp.korpus.cz/) which includes manually-revised data parallel texts for many languages of our interest.
The numbers are thousands of words in the given language available in InterCorp (IC); Czech is the pivot, no Czech text is counted twice. IC-Core is manually aligned, so if we can use InterCorp, then we can directly use these for our test sets.
| Need | Code | Language | IC-Core | IC-Synd | IC-Presseurop | IC-Acquis | IC-Europarl | IC-Subt | IC-Bible | IC-Total |
|---|---|---|---|---|---|---|---|---|---|---|
| EUROSAI | ar | Arabic | 34 | 0 | 0 | 0 | 0 | 0 | 0 | 34 |
| EUROSAI | az | Azerbaijani | ||||||||
| EUROSAI | be | Belarusian | 5,319 | 0 | 0 | 0 | 0 | 0 | 0 | 4,319 |
| EUROSAI | bg | Bulgarian | 7,068 | 0 | 0 | 13,577 | 9,083 | 0 | 0 | 29,728 |
| EUROSAI | bs | Bosnian | ||||||||
| EUROSAI | ca | Catalan | 7,481 | 0 | 0 | 0 | 0 | 0 | 736 | 8,217 |
| EUROSAI | me | Montenegrin | ||||||||
| EU | cs | Czech | 110,573 | 4,351 | 2,310 | 19,085 | 12,908 | 50,604 | 562 | 200,393 |
| EU | da | Danish | 6,654 | 0 | 0 | 20,313 | 13,916 | 14,429 | 657 | 55,968 |
| EU | de | German | 36,373 | 4,704 | 2,483 | 20,610 | 13,088 | 8,392 | 724 | 86,374 |
| EU | el | Greek | 0 | 0 | 0 | 23,853 | 15,404 | 23,709 | 0 | 62,966 |
| EU | en | English | 32,152 | 4,856 | 2,670 | 22,902 | 15,576 | 52,105 | 730 | 130,992 |
| EU | es | Spanish | 25,595 | 5,614 | 2,859 | 26,262 | 16,249 | 36,650 | 0 | 113,228 |
| EU | et | Estonian | 0 | 0 | 0 | 14,896 | 10,899 | 10,298 | 0 | 36,093 |
| EU | fi | Finnish | 5,329 | 0 | 0 | 15,269 | 10,108 | 15,047 | 543 | 46,296 |
| EU | fr | French | 18,241 | 5,600 | 3,046 | 26,200 | 17,179 | 25,986 | 764 | 97,016 |
| EU | ga | Irish | ||||||||
| EUROSAI | he | Hebrew | 0 | 0 | 0 | 0 | 0 | 16,221 | 0 | 16,221 |
| not-needed | hi | Hindu | 409 | 0 | 0 | 0 | 0 | 0 | 0 | 409 |
| EU | hr | Croatian | 21,027 | 0 | 0 | 0 | 0 | 19,048 | 571 | 40,646 |
| EU | hu | Hungarian | 5 783 | 0 | 0 | 17 852 | 12 198 | 21 115 | 0 | 56 948 |
| EUROSAI | hy | Armenian | ||||||||
| EUROSAI | is | Icelandic | 0 | 0 | 0 | 0 | 0 | 1,581 | 0 | 1,581 |
| EU | it | Italian | 13,251 | 1,252 | 2,747 | 23,771 | 15,494 | 14,700 | 684 | 71,899 |
| not-needed | ja | Japanese | 1,747 | 0 | 0 | 0 | 0 | 477 | 0 | 2,224 |
| EUROSAI | ka | Georgian | ||||||||
| EUROSAI | kk | Kazakh | ||||||||
| EUROSAI | lb | Luxembourgish | ||||||||
| EU | lt | Lithuanian | 421 | 0 | 0 | 17,316 | 11,213 | 558 | 471 | 29,979 |
| EU | lv | Latvian | 2,646 | 0 | 0 | 17,522 | 11,682 | 280 | 135 | 32,265 |
| EUROSAI | mk | Macedonian | 8,000 | 0 | 0 | 0 | 0 | 1,877 | 0 | 9,877 |
| not-needed | ms | Malay | 0 | 0 | 0 | 0 | 0 | 3,521 | 0 | 3,521 |
| EU | mt | Maltese | 0 | 0 | 0 | 13,953 | 0 | 0 | 0 | 13,953 |
| EU | nl | Dutch | 15,127 | 813 | 2,953 | 23,416 | 15,558 | 29,373 | 717 | 87,956 |
| EUROSAI | no | Norwegian | 7,151 | 0 | 0 | 0 | 0 | 0 | 721 | 7,872 |
| EU | pl | Polish | 25,606 | 0 | 2,380 | 19,604 | 12,817 | 26,575 | 583 | 87,567 |
| EU | pt | Portuguese | 4,095 | 554 | 2,782 | 24,598 | 15,193 | 41,468 | 706 | 89,396 |
| not-needed | rn | Romani | 14 | 0 | 0 | 0 | 0 | 0 | 0 | 14 |
| EU | ro | Romanian | 3,888 | 0 | 2,738 | 8,092 | 9,446 | 34,128 | 0 | 58,292 |
| EUROSAI | ro-MD | Moldovan | ||||||||
| EUROSAI | ru | Russian | 8,123 | 3,984 | 0 | 0 | 0 | 6,887 | 565 | 19,560 |
| EU | sk | Slovak | 8,545 | 0 | 0 | 18,399 | 12,726 | 5,133 | 561 | 45,363 |
| EU | sl | Slovenian | 3,740 | 0 | 0 | 18,528 | 12,251 | 17,061 | 0 | 51,580 |
| EUROSAI | sq | Albanian | 0 | 0 | 0 | 0 | 0 | 2,003 | 0 | 2,003 |
| EUROSAI | sr | Serbian | 10,961 | 0 | 0 | 0 | 0 | 20,727 | 0 | 31,688 |
| EU | sv | Swedish | 15,320 | 0 | 0 | 19,542 | 13,784 | 14,666 | 638 | 63,950 |
| EUROSAI | tr | Turkish | 0 | 0 | 0 | 0 | 0 | 21,190 | 0 | 21,190 |
| EUROSAI | uk | Ukrainian | 10,817 | 0 | 0 | 0 | 0 | 244 | 596 | 11,657 |
| not-needed | vi | Vietnamese | 0 | 0 | 0 | 0 | 0 | 1,474 | 0 | 1,474 |
| not-needed | zh | Chinese | 0 | 240 | 0 | 0 | 0 | 2,247 | 0 | 2,487 |