Wikidata:Lexicographical coverage

This page presents the lexicographical coverage of the Wikidata Lexicographical data compared to the Wikipedia corpus of the given language.

The scripts to calculate these are in a PAWS notebook. Improvements are very welcome.

More information on this prototype tool: m:Abstract Wikipedia/Updates/2021-02-10#Corpus coverage dashboard

See also Wikidata:Lexicographical data/Statistics.

ar

Forms in Wikidata: 295 Forms in Wikipedia: 246,598 Tokens: 69,840,956 Covered forms: 73 (0.0%) Missing forms: 246,525 (100.0%) Covered tokens: 3,192,997 (4.6%) Missing tokens: 66,647,959 (95.4%) Most frequent missing forms

bg

Forms in Wikidata: 187 Forms in Wikipedia: 118,514 Tokens: 33,132,887 Covered forms: 164 (0.1%) Missing forms: 118,350 (99.9%) Covered tokens: 361,847 (1.1%) Missing tokens: 32,771,040 (98.9%) Most frequent missing forms

br

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 5,417 Forms in Wikipedia: 9,552 Tokens: 1,459,030 Covered forms: 993 (10.4%) Missing forms: 8,559 (89.6%) Covered tokens: 807,404 (55.3%) Missing tokens: 651,626 (44.7%) Most frequent missing forms

bn

(This analysis was performed separately from all the others on this page, using the corpus linked here and custom counting code.)

Forms in Wikidata: 46,504 Forms in Wikipedia: 5,34,894 Tokens: 1,33,06,025 Covered forms: 13,900 (2.60%) Missing forms: 5,20,994 (97.40%) Covered tokens: 50,79,352 (38.17%) Missing tokens: 82,26,673 (61.83%) Most frequent missing forms

ca

Forms in Wikidata: 140 Forms in Wikipedia: 176,311 Tokens: 108,297,498 Covered forms: 100 (0.1%) Missing forms: 176,211 (99.9%) Covered tokens: 11,029,762 (10.2%) Missing tokens: 97,267,736 (89.8%) Most frequent missing forms

cs

Forms in Wikidata: 137,041 Forms in Wikipedia: 261,374 Tokens: 74,084,890 Covered forms: 36,950 (14.1%) Missing forms: 224,424 (85.9%) Covered tokens: 45,472,343 (61.4%) Missing tokens: 28,612,547 (38.6%) Most frequent missing forms

cy

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 110 Forms in Wikipedia: 10,844 Tokens: 1,442,683 Covered forms: 68 (0.6%) Missing forms: 10,776 (99.4%) Covered tokens: 25,845 (1.8%) Missing tokens: 1,416,838 (98.2%) Most frequent missing forms

da

Forms in Wikidata: 59,610 Forms in Wikipedia: 111,139 Tokens: 30,879,404 Covered forms: 25,383 (22.8%) Missing forms: 85,756 (77.2%) Covered tokens: 25,715,167 (83.3%) Missing tokens: 5,164,237 (16.7%) Most frequent missing forms

de

Forms in Wikidata: 87,174 Forms in Wikipedia: 1,008,036 Tokens: 596,433,479 Covered forms: 42,435 (4.2%) Missing forms: 965,601 (95.8%) Covered tokens: 452,812,032 (75.9%) Missing tokens: 143,621,447 (24.1%) Most frequent missing forms

el

Forms in Wikidata: 31 Forms in Wikipedia: 129,276 Tokens: 40,452,744 Covered forms: 25 (0.0%) Missing forms: 129,251 (100.0%) Covered tokens: 16,045 (0.0%) Missing tokens: 40,436,699 (100.0%) Most frequent missing forms

en

Forms in Wikidata: 108,476 Forms in Wikipedia: 965,225 Tokens: 1,508,248,447 Covered forms: 75,557 (7.8%) Missing forms: 889,668 (92.2%) Covered tokens: 1,400,385,834 (92.8%) Missing tokens: 107,862,613 (7.2%) Most frequent missing forms

eo

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 5,695 Forms in Wikipedia: 27,201 Tokens: 4,222,541 Covered forms: 2,124 (7.8%) Missing forms: 25,077 (92.2%) Covered tokens: 2,384,972 (56.5%) Missing tokens: 1,837,569 (43.5%) Most frequent missing forms

es

Forms in Wikidata: 223,925 Forms in Wikipedia: 372,589 Tokens: 405,914,020 Covered forms: 41,780 (11.2%) Missing forms: 330,809 (88.8%) Covered tokens: 343,765,539 (84.7%) Missing tokens: 62,148,481 (15.3%) Most frequent missing forms

et

Forms in Wikidata: 2,728,480 Forms in Wikipedia: 123,073 Tokens: 16,832,892 Covered forms: 72,698 (59.1%) Missing forms: 50,375 (40.9%) Covered tokens: 13,667,980 (81.2%) Missing tokens: 3,164,912 (18.8%) Most frequent missing forms

eu

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 1,002,527 Forms in Wikipedia: 26,466 Tokens: 3,138,442 Covered forms: 16,168 (61.1%) Missing forms: 10,298 (38.9%) Covered tokens: 2,341,144 (74.6%) Missing tokens: 797,298 (25.4%) Most frequent missing forms

fa

Forms in Wikidata: 62 Forms in Wikipedia: 100,251 Tokens: 44,426,012 Covered forms: 42 (0.0%) Missing forms: 100,209 (100.0%) Covered tokens: 191,501 (0.4%) Missing tokens: 44,234,511 (99.6%) Most frequent missing forms

fi

Forms in Wikidata: 8,232 Forms in Wikipedia: 276,898 Tokens: 46,847,582 Covered forms: 4,893 (1.8%) Missing forms: 272,005 (98.2%) Covered tokens: 11,529,858 (24.6%) Missing tokens: 35,317,724 (75.4%) Most frequent missing forms

fr

Forms in Wikidata: 25,038 Forms in Wikipedia: 465,138 Tokens: 474,988,250 Covered forms: 21,501 (4.6%) Missing forms: 443,637 (95.4%) Covered tokens: 371,203,161 (78.1%) Missing tokens: 103,785,089 (21.9%) Most frequent missing forms

ha

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 62 Forms in Wikipedia: 4,816 Tokens: 859,259 Covered forms: 22 (0.5%) Missing forms: 4,794 (99.5%) Covered tokens: 5,981 (0.7%) Missing tokens: 853,278 (99.3%) Most frequent missing forms

he

Forms in Wikidata: 348,296 Forms in Wikipedia: 249,890 Tokens: 76,643,376 Covered forms: 54,537 (21.8%) Missing forms: 195,353 (78.2%) Covered tokens: 41,682,988 (54.4%) Missing tokens: 34,960,388 (45.6%) Most frequent missing forms

hi

Forms in Wikidata: 2,748 Forms in Wikipedia: 54,443 Tokens: 18,734,831 Covered forms: 1,031 (1.9%) Missing forms: 53,412 (98.1%) Covered tokens: 9,177,998 (49.0%) Missing tokens: 9,556,833 (51.0%) Most frequent missing forms

hr

Forms in Wikidata: 1,685 Forms in Wikipedia: 135,627 Tokens: 28,543,040 Covered forms: 1,017 (0.7%) Missing forms: 134,610 (99.3%) Covered tokens: 9,209,901 (32.3%) Missing tokens: 19,333,139 (67.7%) Most frequent missing forms

hu

Forms in Wikidata: 135 Forms in Wikipedia: 274,652 Tokens: 64,674,851 Covered forms: 81 (0.0%) Missing forms: 274,571 (100.0%) Covered tokens: 119,491 (0.2%) Missing tokens: 64,555,360 (99.8%) Most frequent missing forms

id

Forms in Wikidata: 234,446 Forms in Wikipedia: 100,137 Tokens: 40,049,055 Covered forms: 11,246 (11.2%) Missing forms: 88,891 (88.8%) Covered tokens: 18,501,377 (46.2%) Missing tokens: 21,547,678 (53.8%) Most frequent missing forms

ig

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 1,978 Forms in Wikipedia: 1,153 Tokens: 113,878 Covered forms: 354 (30.7%) Missing forms: 799 (69.3%) Covered tokens: 71,190 (62.5%) Missing tokens: 42,688 (37.5%) Most frequent missing forms

it

Forms in Wikidata: 1,534 Forms in Wikipedia: 341,080 Tokens: 284,500,580 Covered forms: 1,200 (0.4%) Missing forms: 339,880 (99.6%) Covered tokens: 121,147,569 (42.6%) Missing tokens: 163,353,011 (57.4%) Most frequent missing forms

ko

Forms in Wikidata: 178 Forms in Wikipedia: 290,844 Tokens: 34,282,183 Covered forms: 130 (0.0%) Missing forms: 290,714 (100.0%) Covered tokens: 1,341,287 (3.9%) Missing tokens: 32,940,896 (96.1%) Most frequent missing forms

la

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 778,456 Forms in Wikipedia: 11,551 Tokens: 1,031,544 Covered forms: 8,307 (71.9%) Missing forms: 3,244 (28.1%) Covered tokens: 884,458 (85.7%) Missing tokens: 147,086 (14.3%) Most frequent missing forms

lb

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 864 Forms in Wikipedia: 10,240 Tokens: 1,365,293 Covered forms: 361 (3.5%) Missing forms: 9,879 (96.5%) Covered tokens: 486,118 (35.6%) Missing tokens: 879,175 (64.4%) Most frequent missing forms

lt

Forms in Wikidata: 34 Forms in Wikipedia: 92,063 Tokens: 13,288,668 Covered forms: 13 (0.0%) Missing forms: 92,050 (100.0%) Covered tokens: 16,458 (0.1%) Missing tokens: 13,272,210 (99.9%) Most frequent missing forms

lv

Forms in Wikidata: 893 Forms in Wikipedia: 60,189 Tokens: 8,004,635 Covered forms: 519 (0.9%) Missing forms: 59,670 (99.1%) Covered tokens: 1,187,959 (14.8%) Missing tokens: 6,816,676 (85.2%) Most frequent missing forms

ml

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 745,401 Forms in Wikipedia: 28,789 Tokens: 1,992,352 Covered forms: 8,467 (29.4%) Missing forms: 20,322 (70.6%) Covered tokens: 1,034,675 (51.9%) Missing tokens: 957,677 (48.1%) Most frequent missing forms

ms

Forms in Wikidata: 4,346 Forms in Wikipedia: 51,515 Tokens: 16,143,659 Covered forms: 1,997 (3.9%) Missing forms: 49,518 (96.1%) Covered tokens: 10,596,491 (65.6%) Missing tokens: 5,547,168 (34.4%) Most frequent missing forms

mt

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 397 Forms in Wikipedia: 5,941 Tokens: 371,515 Covered forms: 259 (4.4%) Missing forms: 5,682 (95.6%) Covered tokens: 123,548 (33.3%) Missing tokens: 247,967 (66.7%) Most frequent missing forms

nan

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 158 Forms in Wikipedia: 5,791 Tokens: 1,119,898 Covered forms: 8 (0.1%) Missing forms: 5,783 (99.9%) Covered tokens: 179,265 (16.0%) Missing tokens: 940,633 (84.0%) Most frequent missing forms

nb

Forms in Wikidata: 69,069 Forms in Wikipedia: 153,555 Tokens: 49,620,256 Covered forms: 31,179 (20.3%) Missing forms: 122,376 (79.7%) Covered tokens: 43,206,039 (87.1%) Missing tokens: 6,414,217 (12.9%) Most frequent missing forms

nl

Forms in Wikidata: 236 Forms in Wikipedia: 260,266 Tokens: 130,343,371 Covered forms: 183 (0.1%) Missing forms: 260,083 (99.9%) Covered tokens: 26,181,317 (20.1%) Missing tokens: 104,162,054 (79.9%) Most frequent missing forms

nn

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 241 Forms in Wikipedia: 23,956 Tokens: 4,198,152 Covered forms: 116 (0.5%) Missing forms: 23,840 (99.5%) Covered tokens: 511,133 (12.2%) Missing tokens: 3,687,019 (87.8%) Most frequent missing forms

pl

Forms in Wikidata: 15,270 Forms in Wikipedia: 333,225 Tokens: 117,356,732 Covered forms: 5,555 (1.7%) Missing forms: 327,670 (98.3%) Covered tokens: 37,747,037 (32.2%) Missing tokens: 79,609,695 (67.8%) Most frequent missing forms

pt

Forms in Wikidata: 31,421 Forms in Wikipedia: 214,847 Tokens: 158,056,230 Covered forms: 12,837 (6.0%) Missing forms: 202,010 (94.0%) Covered tokens: 116,909,138 (74.0%) Missing tokens: 41,147,092 (26.0%) Most frequent missing forms

ro

Forms in Wikidata: 35 Forms in Wikipedia: 119,245 Tokens: 40,889,103 Covered forms: 30 (0.0%) Missing forms: 119,215 (100.0%) Covered tokens: 342,150 (0.8%) Missing tokens: 40,546,953 (99.2%) Most frequent missing forms

ru

Forms in Wikidata: 910,404 Forms in Wikipedia: 651,825 Tokens: 290,067,562 Covered forms: 138,349 (21.2%) Missing forms: 513,476 (78.8%) Covered tokens: 171,044,324 (59.0%) Missing tokens: 119,023,238 (41.0%) Most frequent missing forms

se

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 57,050 Forms in Wikipedia: 1,705 Tokens: 95,453 Covered forms: 49 (2.9%) Missing forms: 1,656 (97.1%) Covered tokens: 3,267 (3.4%) Missing tokens: 92,186 (96.6%) Most frequent missing forms

sk

Forms in Wikidata: 128,107 Forms in Wikipedia: 109,573 Tokens: 18,366,700 Covered forms: 46,035 (42.0%) Missing forms: 63,538 (58.0%) Covered tokens: 12,451,536 (67.8%) Missing tokens: 5,915,164 (32.2%) Most frequent missing forms

sl

Forms in Wikidata: 3 Forms in Wikipedia: 106,577 Tokens: 19,924,659 Covered forms: 3 (0.0%) Missing forms: 106,574 (100.0%) Covered tokens: 4,929 (0.0%) Missing tokens: 19,919,730 (100.0%) Most frequent missing forms

sr

Forms in Wikidata: 27 Forms in Wikipedia: 183,777 Tokens: 42,439,136 Covered forms: 17 (0.0%) Missing forms: 183,760 (100.0%) Covered tokens: 71,064 (0.2%) Missing tokens: 42,368,072 (99.8%) Most frequent missing forms

sv

Forms in Wikidata: 227,078 Forms in Wikipedia: 219,718 Tokens: 72,173,155 Covered forms: 60,173 (27.4%) Missing forms: 159,545 (72.6%) Covered tokens: 63,565,875 (88.1%) Missing tokens: 8,607,280 (11.9%) Most frequent missing forms

ta

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 1,916 Forms in Wikipedia: 31,721 Tokens: 2,539,025 Covered forms: 316 (1.0%) Missing forms: 31,405 (99.0%) Covered tokens: 104,404 (4.1%) Missing tokens: 2,434,621 (95.9%) Most frequent missing forms

tg

These statistics use corpus data from the Leipzig Corpora Collection.

Forms in Wikidata: 1,490 Forms in Wikipedia: 9,793 Tokens: 1,252,518 Covered forms: 417 (4.3%) Missing forms: 9,376 (95.7%) Covered tokens: 268,081 (21.4%) Missing tokens: 984,437 (78.6%) Most frequent missing forms

th

Forms in Wikidata: 10 Forms in Wikipedia: 27,089 Tokens: 2,068,858 Covered forms: 9 (0.0%) Missing forms: 27,080 (100.0%) Covered tokens: 4,219 (0.2%) Missing tokens: 2,064,639 (99.8%) Most frequent missing forms

tl

Forms in Wikidata: 6 Forms in Wikipedia: 20,893 Tokens: 3,583,109 Covered forms: 1 (0.0%) Missing forms: 20,892 (100.0%) Covered tokens: 1,100 (0.0%) Missing tokens: 3,582,009 (100.0%) Most frequent missing forms

tr

Forms in Wikidata: 37 Forms in Wikipedia: 151,341 Tokens: 30,211,406 Covered forms: 32 (0.0%) Missing forms: 151,309 (100.0%) Covered tokens: 142,166 (0.5%) Missing tokens: 30,069,240 (99.5%) Most frequent missing forms

uk

Forms in Wikidata: 238,190 Forms in Wikipedia: 356,409 Tokens: 114,386,141 Covered forms: 26,455 (7.4%) Missing forms: 329,954 (92.6%) Covered tokens: 11,596,722 (10.1%) Missing tokens: 102,789,419 (89.9%) Most frequent missing forms

vi

Forms in Wikidata: 43 Forms in Wikipedia: 60,377 Tokens: 75,656,151 Covered forms: 21 (0.0%) Missing forms: 60,356 (100.0%) Covered tokens: 2,012,387 (2.7%) Missing tokens: 73,643,764 (97.3%) Most frequent missing forms