Wikidata:WikiProject 20th Century Press Archives/Tools & Tasks/Log
(Redirected from User:Jneubert/PM20 project)
2017[edit]
- August 2017
- Property Pressemappe 20. Jahrhundert IFIS proposed (by User:YMS)
- October 2017
- purl.org persistent URIs for PM20 folders introduced
- Property PM20 folder ID (P4293) for person/company/wares/subject headings folders introduced, based on purl.org URIs
- M-n-m catalog PM folder ID (created by User:Magnus_Manske)
- Added PM20 folder ID (P4293) to items identified via GND ID (P227) (from PM20 Beacon lists)
2018[edit]
- March 2018
- DFG-Viewer folder view for all PM20 folders (spin-off from P20-LOD)
- June 2018
- Example application Map of economists in PM20 by place of birth
- Pattern for inexactly matching companies introduced
- July 2018
- CC0 license assigned to 20th Century Press Archives (Q36948990) metadata
- SPARQL endpoint http://zbw.eu/beta/sparql/pm20/query, for now with labels and document counts
- August 2018
- Qualifier number of works accessible online (P5592) introduced
- number of works (P3740) and number of works accessible online (P5592) for 5508 items added via QS (#3316 - #3319)
- October 2018
- doc counts (including 0/unknown) for 4550 items added (QS #4815 - #4817)
- Github repo for Coding da Vinci Rhein-Main 2018, persons and companies folders (dataset download)
- Extended SPARL endpoint
- Alpha vocabs in Skosmos
- November 2018
- Bot request for adding items from PM20
- Batch pm20 add class 1 157 organization classes (wikidata/results/missing_class_via_pm20.2018-11-29.qs.txt)
- Batch pm20 doc count 10 for 91 items (pm20/results/folder_doc_counts.2018-11-29.qs.txt)
- December 2018
- Unnamed batch "companies" for 20 items (companies_missing_in_wikidata.2018-12-04.qs.txt)
2019[edit]
- February 2019
- Batch pm20 doc count 11 for 471 items (pm20/results/folder_doc_counts.2019-02-26.qs.txt)
- Unnamed batch "named as" for 26 (+3) (+9) subject items (pm20/results/folder_names.2019-02-26.qs.txt)
- Batch pm20 doc count 12 for 543 items (wikidata/results/folder_doc_counts.2019-02-28.qs.txt)
- March 2019
- Wikidata:WikiProject 20th Century Press Archives created
- June 2019
- Batch pm20 via gnd 2 for 100 items ../wikidata/results/missing_pm20_id_via_gnd.2019-06-13.qs.txt
- Batch pm20 folder name for 9 items ../wikidata/results/pm20_folder_names.2019-06-13.qs.txt
- Batch pm20 doc count 13 for 42 items ../wikidata/results/pm20_folder_doc_counts.2019-06-13.qs.txt (33 errors, vanished with re-run)
- Tests with generated new items
- All missing pm20 person items - Batch pm20 person add for 346 items ../pm20/results/persons_missing_in_wikidata.2019-06-13.qs.txt (77 errors, vanished all but 1 with "Try to reset errors")
- Batch enhance P569/P570 (one item) and P227 pm20 enhance P227 for 60 items ../pm20/results/P227_property_missing_in_wikidata.2019-06-13.qs.txt
- Batch pm20 doc count 14 for 356 items ../wikidata/results/pm20_folder_doc_counts.2019-06-14.qs.txt
- Batch pm20 occupation economist for 64 items ../pm20/results/P106_wd_occupation_economist.2019-06-14.qs.txt
- July 2019
- Batch pm20 family 1 for 42 items ../pm20/results/P53_wd_person_family.2019-07-16.qs.txt
- September 2019
- Mix-n-Match catalog for newspapers
- October 2019
- Batch pm20 occupation social|earth scientist for 9 items ../pm20/results/P106_wd_occupation_economist.2019-10-03.qs.txt
- Batch pm20_company_founder_1 for 54 items ../wikidata/results/P112_pm20_company_person.2019-10-05.qs.txt
- Batch pm20_company_advisory_board_1 for 56 items ../wikidata/results/P5052_pm20_company_person.2019-10-05.qs.txt
- Batch pm20_company_board_1 for 749 items ../wikidata/results/P3320_pm20_company_person.2019-10-05.qs.txt
- Batch pm20 doc count 15 for 27 items ../wikidata/results/pm20_folder_doc_counts.2019-10-17.qs.txt
- Batch pm20 pe folder names 1 for 9471 items ../pm20/results/folder_names_qs.2019-10-18.qs.txt
- Batch pm20 via gnd 3 for 13 items ../wikidata/results/missing_pm20_id_via_gnd.2019-10-18.qs.txt
2020[edit]
- April 2020
- Batch pm20 pe folder name 2 for 120 items ../pm20/results/folder_names_qs.2020-04-02.qs.txt
- Batch pm20 doc count 16 for 54 items ../wikidata/results/pm20_folder_doc_counts.2020-04-02.qs.txt
- Batch folder name 3 for 25 items ../pm20/results/folder_names_qs.2020-04-21.qs.txt
- Batch doc count 17 for 15 items (errors resolved by re-run) ../wikidata/results/pm20_folder_doc_counts.2020-04-21.qs.txt
- Created Germany : Individual diseases and their control (Q91257808) as example item for subject folders, with according PM20 folder classes
- May 2020
- Batch pm20 economist 2 for 5 titems ../pm20/results/P106_wd_occupation_economist.2020-05-25.qs.txt
- June 2020
- Mapping of the PM20 geographic categories to WD created
- July 2020
- Properties PM20 geo code (P8483) and PM20 subject code (P8484) introduced
- Data model for country/subject archives finalized
- August 2020
- Batch pm20 sh geo code 1 for 146 items. Large number of errors with almost all qualifiers, resolved by 4 re-runs ../pm20/results/add_category_code.2020-08-13.qs.txt
- Batch pm20 geo doc count 1 for 145 items. Errors with all number of works (P3740) values - had to be repeated in a separate job with statements with only this property ../pm20/results/add_category_doc_counts.2020-08-14.qs.txt
- September 2020
- Batch pm20 subject folders 1 for 156 items ../pm20/results/subject_folders_for_wikidata.2020-09-16.qs.txt
- Batch pm20 subject category 1 for 155 items ../pm20/results/subject_categories_for_wikidata.2020-09-17.qs.txt
- Batch pm20 subject category P361 1 for 131 items ../pm20/results/P361_wd_category_partof.2020-09-18.qs.txt
- Batch pm20 subject folder 2 for 20 items ../pm20/results/subject_folders_for_wikidata.2020-09-18_a.qs.txt
- Batch pm20 subject folder 3 for 50 items ../pm20/results/subject_folders_for_wikidata.2020-09-18_b.qs.txt
- Batch pm20 subject folder 4 for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-18_c.qs.txt
- Batch pm20 subject folder 5 and pm20 subject folder 6 for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-24.qs.txt
- Batch pm20 subject folder 6 for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-28.qs.txt
- Run "pm20 subject folder 7" for 100 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_a.qs.txt
- Run "pm20 subject folder 8" for 1000 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_b.qs.txt
- Run "pm20 subject folder 9" for 1000 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_c.qs.txt
- Run "pm20 subject folder 10" for 1000 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_d.qs.txt hanging after 315 items, aborted
- Run "pm20 subject folder 11" for 839 items ../pm20/results/subject_folders_for_wikidata.2020-09-29_e.qs.txt
- December 2020
- Preparations for deeper nested subject categories and folders (English labels, proper hierarchy, etc.)
2021[edit]
- January 2021
- Run "pm20 subject category 2" for 100 items ../pm20/results/subject_categories_for_wikidata.2021-01-06a.qs.txt
- Run "pm20 subject category P361 2" for 117 items ../pm20/results/P361_wd_category_partof.2021-01-06a.qs.txt
- Batch pm20 subject category 3 for 99 of 100 items ../pm20/results/subject_categories_for_wikidata.2021-01-06b.qs.txt
- Batch pm20 subject category 4 for 296 of 300 items ../pm20/results/subject_categories_for_wikidata.2021-01-06c.qs.txt
- Batch pm20 subject category 5 for 300 items ../pm20/results/subject_categories_for_wikidata.2021-01-07a.qs.txt (including formerly erronous, after making labels unique)
- Batch pm20 subject category 6 for 443 items ../pm20/results/subject_categories_for_wikidata.2021-01-07b.qs.txt
- Run "pm20 subject category 7" for 55 items ../pm20/results/subject_categories_for_wikidata.2021-01-07c.qs.txt (missing folderCount=0)
- Run "pm20 subject category 8" for 3 items ../pm20/results/subject_categories_for_wikidata.2021-01-07d.qs.txt (missing folderCount=0)
- Manual cleanup of ~ 50 duplicates produced by QS in batch mode
- Batch pm20 subject category P361 2 for 1174 items ../pm20/results/P361_wd_category_partof.2021-01-07a.qs.txt
- Batch pm20 subject category P8484 1 for 1451 items ../pm20/results/P8484_wd_category_partof.2021-01-07a.qs.txt
- Run "pm20 subject category 9" for 5 of 6 items ../pm20/results/subject_categories_for_wikidata.2021-01-07e.qs.txt (more hierarchy fixes)
- Batch pm20 subject category P361 3 for 23 items ../pm20/results/P361_wd_category_partof.2021-01-07b.qs.txt (hierarchy fixes)
- Run "pm20 geo category P8483" for 152 items ..//pm20/results/P8483_wd_geo_category_longnotation.2021-01-08.qs.txt
- Run "pm20 subject folder" for 20 items ../pm20/results/subject_folders_for_wikidata.2021-01-08a.qs.txt
- Run "pm20 subject folder" for 1000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08b.qs.txt
- Run "pm20 subject folder" for 1000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08c.qs.txt
- Run "pm20 subject folder" for 468 of 1000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08d.qs.txt
- Run "pm20 subject folder" for 2000 items ../pm20/results/subject_folders_for_wikidata.2021-01-08e.qs.txt
- Run "pm20 subject folder" for 939 items ../pm20/results/subject_folders_for_wikidata.2021-01-08f.qs.txt
- Batch pm20 folder name 4 for 211 items ../pm20/results/folder_names_qs.2021-01-20.qs.txt
- Batch pm20 doc count 18 for 2000 items ../pm20/results/folder_doc_counts.2021-01-20a.qs.txt 559 errors (for P3740 "somevalue") after multiple tries to reset
- Run "pm20 doc count" for 200 items ../pm20/results/folder_doc_counts.2021-01-21a.qs.txt
- Run "pm20 doc count" for 2000 items ../pm20/results/folder_doc_counts.2021-01-21b.qs.txt aborted after c. 700 items
- Run "pm20 doc count" for 1000 items ../pm20/results/folder_doc_counts.2021-01-21c.qs.txt aborted after c. 300 items
- Batch pm20 doc count 19 for 1000 items ../pm20/results/folder_doc_counts.2021-01-21d.qs.txt multiple errors, most resetable
- Batch pm20 doc total count 1 for 1000 items ../pm20/results/folder_doc_total_count.2021-01-21a.qs.txt 42 errors, reset to 34
- Batch pm20 doc total count 2 for 5223 items ../pm20/results/folder_doc_total_count.2021-01-21b.qs.txt 243 errors -> reset 182 -> reset 182 (all "somevalue")
- Batch pm20 doc online count 1 for 100 items ../pm20/results/folder_doc_online_count.2021-01-21a.qs.txt
- Batch pm20 doc online count 2 for 6122 items ../pm20/results/folder_doc_online_count.2021-01-21b.qs.txt
- February 2021
- Batch pm20 via gnd 4 for 172 items ../wikidata/results/missing_pm20_id_via_gnd.2021-02-19.qs.txt
- March 2021
- Run "pm20 via gnd 5" for 5 items ../wikidata/results/missing_pm20_id_via_gnd.2021-03-26.qs.txt
- Run "pm20 company founder 2" for 4 items ../wikidata/results/P112_pm20_company_person.2021-03-26.qs.txt
- Batch pm20 company board 2 for 25 items /opt/sparql-queries/wikidata/results/P3320_pm20_company_person.2021-03-26.qs.txt - Required some retries
- April 2021
- Github repo for Coding da Vinci SH 2021, updated persons and companies folders (dataset download)
- Map company/institution types to Wikidata (per query)
- Mix-n-Match catalog PM20 companies nl
- Run "companies 2 (nl)" for adding 164 items ../pm20/results/companies_missing_in_wikidata.2021-04-30.qs.txt
- For companies nl, in total: ~ 50 linked, 166 added
- May 2021
- Batch pm20 id via wp link 1 for 573 items ../wikidata/results/missing_pm20_id_via_wplink.2021-05-03.qs.txt
- Mix-n-match catalog PM20 companies en
- Run "companies 3 (en) adding 33 items /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-05-07.qs.txt
- Multiple small batches and manual insertions, up to adding the last 93 items for companies en /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-05-27.qs.txt
- For companies en, in total: ~ 750 linked, 1454 added
- At start of Wikilang de (2021-05-27), 2737 not linked (RT does not count here) - first newly created Q107013760
- For Wikilang und, 125 not linked; for Wikilang fr, 1022 not linked
- Mix-n-Match catalog PM20 companies de
- June 2021
- Multiple small batches and manual insertions, up to adding the last 231 items for companies de /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-06-10.qs.txt
- For companies de, in total: 244 linked, 2493 added
- Mix-n-Match catalog PM20 companies fr (initially: 257 manually, 24 automatically, 985 not matched)
- Multiple small batches and manual insertions, up to adding the last 20 items for companies fr /opt/sparql-queries/pm20/results/companies_missing_in_wikidata.2021-06-17.qs.txt
- For companies fr, in total: 141 linked, 868 added
- Mix-n-Match catalog PM20 companies div (initially: c. 75 manually, 0 automatically, c. 110 not matched)
- For companies div, in total: c. 35 linked, 75 added
- Batch pm20 folder name 6 for 3000 items ../pm20/results/folder_names_qs.2021-06-18a.qs.txt
- Batch pm20 folder name 7 for 3000 items ../pm20/results/folder_names_qs.2021-06-18b.qs.txt
- Batch pm20 folder name 8 for 3271 items ../pm20/results/folder_names_qs.2021-06-18.qs.txt
- Batch pm20 doc count 20 for 3500 items ../pm20/results/folder_doc_total_count.2021-06-21a.qs.txt
- Batch pm20 doc count 21 for 3647 items ../pm20/results/folder_doc_total_count.2021-06-21.qs.txt
- plus interactive run for the remaining errors (in particular, somevalue entries)
- Batch pm20 doc online count 3 for 2999 items ../pm20/results/folder_doc_online_count.2021-06-21a.qs.txt
- Batch pm20 doc online count 3 for 3965 items ../pm20/results/folder_doc_online_count.2021-06-21.qs.txt
- Various cleanups
- Batch pm20 folder name 9 for 176 items ../pm20/results/folder_names_qs.2021-06-28.qs.txt
- Batch pm20 doc total count 22 for 144 items ../pm20/results/folder_doc_total_count.2021-06-28.qs.txt
- Batch pm20 doc online count 4 for 138 items ../pm20/results/folder_doc_online_count.2021-06-28.qs.txt
- Batch pm20 fr labels for 848 items ../pm20/results/wd_french_labels.2021-06-28.qs.txt
- Batch pm20 co inception for 310 items ../pm20/results/P571_property_missing_in_wikidata.2021-06-28.qs.txt
- Batch pm20 co demolition for 205 items ../pm20/results/P576_property_missing_in_wikidata.2021-06-28.qs.txt
- Batch pm20 co add gnd for 880 items ../pm20/results/P227_property_missing_in_wikidata.2021-06-28.qs.txt
- Batch pm20 co add P31 for 167 items ../pm20/results/P31_property_missing_in_wikidata.2021-06-29.qs.txt
- Batch pm20 co founder for 43 items ../wikidata/results/P112_property_missing_in_wikidata.2021-06-29.qs.txt
- Batch pm20 co board for 80 items ../wikidata/results/P3320_property_missing_in_wikidata.2021-06-29.qs.txt
- Batch pm20 co advisory board for 29 items ../wikidata/results/P5052_property_missing_in_wikidata.2021-06-29.qs.txt
- July 2021
- Batch pm20 co parent for 954 items (+ inverse) ../wikidata/results/P749_pm20_company_parent.2021-07-01.qs.txt
- Batch pm20 co predecessor for 760 items (+ inverse) ../wikidata/results/P749_pm20_company_predecessor.2021-07-02.qs.txt
- Batch pm20 company location 1 for 2000 items ../wikidata/results/P159_pm20_company_location.2021-07-05a.qs.txt
- Batch pm20 company location 2 for 2268 items ../wikidata/results/P159_pm20_company_location.2021-07-05.qs.txt
- Run "pm20 co country 1" for 198 items (NL) ../wikidata/results/P159_pm20_company_country.2021-07-09a.qs.txt
- Batch pm20 co country 2 for 1608 items (GB) ../wikidata/results/P159_pm20_company_country.2021-07-09b.qs.txt
- Batch pm20 co country 3 for 2000 items (DE) ../wikidata/results/P159_pm20_company_country.2021-07-09c.qs.txt
- Batch pm20 co country 4 for 246 items (DE) ../wikidata/results/P159_pm20_company_country.2021-07-09d.qs.txt
- Batch pm20 co country 5 for 1833 items (div) ../wikidata/results/P159_pm20_company_country.2021-07-09e.qs.txt
- Batch pm20 co nace 1 for 2000 items /opt/sparql-queries/wikidata/results/P452_pm20_company_nace.2021-07-20a.qs.txt
- Batch pm20 co nace 2 for 2258 items /opt/sparql-queries/wikidata/results/P452_pm20_company_nace.2021-07-20.qs.txt
- Batch pm20 co nace 1 method for 1995 items ../wikidata/results/P452_pm20_company_nace_method.2021-07-20a.qs.txt
- Batch pm20 co nace 2 method for 2258 items ../wikidata/results/P452_pm20_company_nace_method.2021-07-20.qs.txt
- Batch pm20 co industry 1 for 2000 items ../wikidata/results/P452_pm20_company_industry.2021-07-21a.qs.txt
- Batch pm20 co industry 2 for 2000 items ../wikidata/results/P452_pm20_company_industry.2021-07-21b.qs.txt
- Batch pm20 co industry 3 for 2000 items ../wikidata/results/P452_pm20_company_industry.2021-07-21c.qs.txt
- Batch pm20 co industry 4 for 2943 items ../wikidata/results/P452_pm20_company_industry.2021-07-21d.qs.txt
2022[edit]
- July
- Property PM20 ware ID (P10890) created
- August
- Batch pm20 ware id for 83 items (matching from OpenRefine) ../pm20/results/wd_waren_links.qs.txt
- Run "pm20 ware categories" for 5 special category items ../pm20/results/ware_categories_for_wikidata.2022-08-01.qs.txt
- Batch pm20 create ware folder items 2 for 1520 items ../pm20/results/ware_folders_for_wikidata.2022-08-04.qs.txt
- Batch pm20 doc total count 6 for 1808 items ../pm20/results/folder_doc_online_count.2022-08-04.qs.txt - 175 errors remaining ("{ "type": "somevalue", "value": "somevalue" }"), fixed by running the statements interactively
- Batch pm20 doc online count 6 for 1763 items ../pm20/results/folder_doc_online_count.2022-08-04.qs.txt
- Dezember
- Batch pm20 sh geo code 2 (should be wa geo code) for 154 items ../pm20/results/add_category_code.2022-12-28.qs.txt
- Batch pm20 create ware folder items 2 for 1333 items ../pm20/results/ware_folders_for_wikidata.2022-12-28.qs.txt
- Batch pm20 doc total count 7 for 1364 items ../pm20/results/folder_doc_total_count.2022-12-28.qs.txt
- Batch pm20 doc online count 7 for 1462 items ../pm20/results/folder_doc_online_count.2022-12-28.qs.txt
- Run "create ware folder items 3" for 36 missing items ../pm20/results/ware_folders_for_wikidata.2022-12-29.qs.txt
- Run "pm20 doc total count 8" for 79 items ../pm20/results/folder_doc_total_count.2022-12-29.qs.txt
- Batch pm20 doc online count 8 for 1462 items ../pm20/results/folder_doc_online_count.2022-12-28.qs.txt
- Batch pm20 ware name 1 for 95 items (ware categories) ../pm20/results/ware_names_qs.2022-12-30.qs.txt
2023[edit]
- January
- Batch pm20 category partof qualifier for 1437 items ../pm20/results/P361_wd_category_partof.2023-01-10.qs.txt
- Run "wd category haspart" for 1428 items ../pm20/results/P527_wd_category_haspart.2023-01-10.qs.txt
- Batch pm20 folder subject remove 1 for 53 items ../pm20/results/folder_subject_remove_qs.2023-01-11.qs.txt
- Batch pm20 folder subject add 1 for 54 items ../pm20/results/folder_subject_add_qs.2023-01-11.qs.txt
- July
- temporary Batch load film section, 1st filming co for 2283 items
- November
- Full-text search function https://pm20-search.toolforge.org added
2024[edit]
- February
- Batch add film sections h1_co 2 for 5 items ../data/wd_input/add_film_sections_h1_co_2.qs.txt
- Batch add film sections h2_co for 625 items ../data/wd_input/add_film_sections_h2_co.qs.txt
- April
- Batch add filmsections h1_co for 2 items ../data/wd_input/add_film_sections_h1_co.2024-04-08.qs.txt - apparently duplicate to prior runs
- Batch add filmsections h2_co for 164 items ../data/wd_input/add_film_sections_h2_co.2024-04-08.qs.txt