Hi all!
As part of the WDQS Graph Split project,[1] we have new SPARQL endpoints available for serving the “main”[2] and “scholarly”[3] subgraphs of Wikidata.
As you might be aware we are addressing the Wikidata Query Service stability and scaling issues. We have been working on several projects to address these issues. This announcement is about one of them, the WDQS Graph Split.[1] This change will have an impact on certain uses of the Wikidata Query Service.
We are now entering a transition period until the end of February 2025. The three SPARQL endpoints will remain in place until the end of the transition. At the end of the transition, query.wikidata.org will serve the main Wikidata subgraph (without scholarly articles). The query-main and query-scholarly endpoints will continue to be available after the transition.
If you know to want more this change, please refer to the talk page on Wikidata.[4]
Have fun!
Guillaume
[1] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_graph_split [2] https://query-main.wikidata.org [3] https://query-scholarly.wikidata.org [4] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_backend_upd...
Hello Guillaume -- is the idea no longer for query.wikidata to serve federated queries across -main and -scholarly? Where will federated querying happen? SJ
On Tue, Sep 3, 2024 at 4:01 PM Guillaume Lederrey glederrey@wikimedia.org wrote:
Hi all!
As part of the WDQS Graph Split project,[1] we have new SPARQL endpoints available for serving the “main”[2] and “scholarly”[3] subgraphs of Wikidata.
As you might be aware we are addressing the Wikidata Query Service stability and scaling issues. We have been working on several projects to address these issues. This announcement is about one of them, the WDQS Graph Split.[1] This change will have an impact on certain uses of the Wikidata Query Service.
We are now entering a transition period until the end of February 2025. The three SPARQL endpoints will remain in place until the end of the transition. At the end of the transition, query.wikidata.org will serve the main Wikidata subgraph (without scholarly articles). The query-main and query-scholarly endpoints will continue to be available after the transition.
If you know to want more this change, please refer to the talk page on Wikidata.[4]
Have fun!
Guillaume
[1] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_graph_split [2] https://query-main.wikidata.org [3] https://query-scholarly.wikidata.org [4] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_backend_upd...
-- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation https://wikimediafoundation.org/ _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
Hello Samuel!
Thanks for the question! The explanation was probably not clear enough on the wiki page [1]. I'll see if I can reword it in a way that makes more sense. In the meantime, let's see if I can make things more clear here:
For the transition period, we want to limit as much as possible the impact on anyone, so query.wikidata.org will continue serving the full graph. The 2 new endpoints are created to serve the "main" and "scholarly" subgraphs. All those endpoints can be federated together. After the transition period, query.wikidata.org and query-main.wikidata.org will point to the same dataset. Some of that is explained in the Federation Guide [2].
I hope that helps!
Guillaume
[1] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_backend_upd... [2] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_graph_split... ?
On Wed, 4 Sept 2024 at 06:30, Samuel Klein meta.sj@gmail.com wrote:
Hello Guillaume -- is the idea no longer for query.wikidata to serve federated queries across -main and -scholarly? Where will federated querying happen? SJ
On Tue, Sep 3, 2024 at 4:01 PM Guillaume Lederrey glederrey@wikimedia.org wrote:
Hi all!
As part of the WDQS Graph Split project,[1] we have new SPARQL endpoints available for serving the “main”[2] and “scholarly”[3] subgraphs of Wikidata.
As you might be aware we are addressing the Wikidata Query Service stability and scaling issues. We have been working on several projects to address these issues. This announcement is about one of them, the WDQS Graph Split.[1] This change will have an impact on certain uses of the Wikidata Query Service.
We are now entering a transition period until the end of February 2025. The three SPARQL endpoints will remain in place until the end of the transition. At the end of the transition, query.wikidata.org will serve the main Wikidata subgraph (without scholarly articles). The query-main and query-scholarly endpoints will continue to be available after the transition.
If you know to want more this change, please refer to the talk page on Wikidata.[4]
Have fun!
Guillaume
[1] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_graph_split [2] https://query-main.wikidata.org [3] https://query-scholarly.wikidata.org [4] https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/WDQS_backend_upd...
-- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation https://wikimediafoundation.org/ _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org
https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
-- Samuel Klein @metasj w:user:sj +1 617 529 4266 _______________________________________________ Wikitech-l mailing list -- wikitech-l@lists.wikimedia.org To unsubscribe send an email to wikitech-l-leave@lists.wikimedia.org https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/