User:TiagoLubiana/Graph Split Links

This is a small, temporary page aggregating links related to the Wikidata Query Service Graph split of May, 2025.

This is a starting point for the docs at

https://meta.wikimedia.org/wiki/Wikimedia_CH/Grant_apply/Documentation_for_2025_Wikidata_Graph_Split

Goals

1. Establish and maintain an FAQ on the graph split
   1. Note what Wikidata activities change, and what tools / workflows/ users are affected
   2. We will pay special attention to questions posed by those who work on translations
2. Convert existing meeting documentation on the graph split into a narrative on Meta-Wiki
3. Report the results of the Scholia user survey 2024 to give insight to a WikiCite user community, and to guide a future survey
4. Convert Scholia hackathon outcomes from October 2024, November 2024, and April 2025 into documentation associated with the overall WikiCite project
5. Do storytelling for the proposals of planned Wikidata developments, and why they matter
   1. Benchmarking of potential Blazegraph replacements (Qlever, Virtuoso, any others)
   2. Loading data dumps into a graph engine, then running federated queries with any number of SPARQL endpoints
   3. Re-assessing what content is desirable and reasonable for the Wikidata community to curate in Wikidata
   4. Rewriting Wikidata queries for federation

Timeline

--> May 15 2024, the scheduled period for refinement of split rules ended (Wikidata:SPARQL query service/WDQS graph split/WDQS Split Refinement)

Affected projects

• https://meta.wikimedia.org/wiki/WikiCite
• Wikidata:WikiCite
• Wikidata:Scholia

Related WikiProjects

• Wikidata:WikiProject Limits of Wikidata

Affected tools

Wikidata:SPARQL query service/WDQS graph split/Affected tools --> Needs maintenance here

https://tiago.bio.br/bioinfo_brasil/dashboard.html --> Find my tools

Background

Wikidata:SPARQL query service/WDQS backend update

2022 paper on the alternatives --> File:WDQS Backend Alternatives working paper.pdf

Docs

• Wikidata:SPARQL query service/WDQS graph split
• https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service/Technical_interactions
• https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service
• https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2024-05-16/Op-Ed
• https://etherpad.wikimedia.org/p/wdqs-graph-split-2024-02-15-1
• https://survey.wikimedia.it/index.php/179555?lang=en
• Wikidata:SPARQL query service/Alternative endpoints

• WDQS programmed graph split (Q130342413), nice work by Dennis and Egon

Tech

https://wikitech.wikimedia.org/wiki/Wikidata_Query_Service

Graph split rules

On the GitHub Mirror :

https://github.com/wikimedia/wikidata-query-rdf/blob/master/tools/src/main/resources/wdqs-subgraph-definitions-v1.yaml

https://github.com/wikimedia/wikidata-query-rdf/blob/master/tools/src/main/resources/wdqs-subgraph-definitions-v2.yaml

On Gerrit:

https://gerrit.wikimedia.org/r/plugins/gitiles/wikidata/query/rdf/+/refs/heads/master/tools/src/main/resources/wdqs-subgraph-definitions-v2.yaml

Graph split processing (Scala + Spark)

https://github.com/wikimedia/wikidata-query-rdf/blob/master/rdf-spark-tools/src/main/scala/org/wikidata/query/rdf/spark/transform/structureddata/dumps/ScholarlyArticleSplitter.scala

WDQS Alternatives

https://meta.wikimedia.org/wiki/Grants:Project/Future-proof_WDQS

FAQ - Extended version

• Wikidata:SPARQL query service/WDQS graph split#FAQ

Which items exactly are included only in the scholarly graph?

Are there any triples common to both the scholarly and the main graphs?

Are other bits of Wikidata going to be split in the future? E.g. for access via the REST API?