Discovery

discovery@lists.wikimedia.org

766 discussions

Re: [Cloud] Getting CirrusSearch data from PAWS
by Adam Baso 16 Oct '25

16 Oct '25

Hello! Would you be able to explain a little more on the access pattern? Is this going to be a bulk operation across, for example, all articles on a wiki? Would you mind posting your reply on this list as well as, after signing up (if not already signed up), on the discovery list ( https://lists.wikimedia.org/postorius/lists/discovery.lists.wikimedia.org/ ) ? Thanks! -Adam On Mon, Oct 13, 2025 at 9:24 AM <delahera(a)gmail.com> wrote: > Hi! I'm trying to get articletopic predictions for a bunch of Wikipedia > articles.[1] This value is cached in Elasticsearch indices,[2] under the > WeightedTags field.[3] > > Because using CirrusSearch through the Action API would return at most 500 > results,[4] I was thinking of querying the CirrusSearch database directly. > > I've seen there is the CloudElastic replica,[5] but I'm not being able to > use it from PAWS. Is it only available from Cloud VPS and Toolforge? > > Otherwise, can you suggest an alternative for what I'm trying to > accomplish? Thank you! > > [1] > https://api.wikimedia.org/wiki/Lift_Wing_API/Reference/Get_articletopic_out… > [2] https://wikitech.wikimedia.org/wiki/Search/articletopic > [3] https://wikitech.wikimedia.org/wiki/Search/WeightedTags > [4] https://www.mediawiki.org/w/api.php?action=help&modules=query%2Bsearch > [5] > https://wikitech.wikimedia.org/wiki/Help:CirrusSearch_OpenSearch_replicas > _______________________________________________ > Cloud mailing list -- cloud(a)lists.wikimedia.org > List information: > https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/ >

2 1

Talk to the Search Platform / Query Service Team—October 1, 2025
by Guillaume Lederrey 01 Oct '25

01 Oct '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, October 1, 2025 Time: 15:00-16:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Talk to the Search Platform / Query Service Team—September 3, 2025
by Guillaume Lederrey 03 Sep '25

03 Sep '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, September 3, 2025 Time: 15:00-16:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Talk to the Search Platform / Query Service Team—June 4, 2025
by Guillaume Lederrey 04 Jun '25

04 Jun '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, June 4, 2025 Time: 15:00-16:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! Guillaume *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Talk to the Search Platform / Query Service Team—May 7, 2025
by Guillaume Lederrey 07 May '25

07 May '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, May 7, 2025 Time: 15:00-16:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! Guillaume -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Talk to the Search Platform / Query Service Team—April 2, 2025
by Guillaume Lederrey 02 Apr '25

02 Apr '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, April 2, 2025 Time: 15:00-16:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! Guillaume -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Talk to the Search Platform / Query Service Team—March 5, 2025
by Guillaume Lederrey 05 Mar '25

05 Mar '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, March 5, 2025 Time: 16:00-17:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! Guillaume -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Talk to the Search Platform / Query Service Team - February 12
by Guillaume Lederrey 12 Feb '25

12 Feb '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. This month is an exception, the team is at an offsite on February 5th, our office hours are moved to February 12. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, February 12, 2025 Time: 16:00-17:00 UTC / 08:00 PST / 11:00 EST / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 2

preliminary results of re-running several existing Wikidata benchmarks
by Peter F. Patel-Schneider 26 Jan '25

26 Jan '25

As part of an effort to benchmark open source SPARQL engines on Wikidata, the page https://www.wikidata.org/wiki/Wikidata:Scaling_Wikidata/Benchmarking/Existi… contains some initial results and analyses of benchmarking Blazegraph, MilleniumDB, QLever, and Virtuoso on several existing SPARQL query benchmarks for Wikidata. There are some surprising results there, particularly related to different answers produced by different engines. Suggestions on how to improve the effort or provide deeper explanations of the results are particularly welcome on the discussion page. Peter F. Patel-Schneider

1 0

Talk to the Search Platform / Query Service Team—January 8, 2025
by Guillaume Lederrey 08 Jan '25

08 Jan '25

Hello all! The Search Platform Team usually holds an open meeting on the first Wednesday of each month. Since this month would have been January 1st, we're moving to January 8 instead. Come talk to us about anything related to Wikimedia search, Wikidata Query Service (WDQS), Wikimedia Commons Query Service (WCQS), etc.! Feel free to add your items to the Etherpad Agenda for the next meeting. Details for our next meeting: Date: Wednesday, January 8, 2025 Time: 16:00-17:00 UTC / 08:00 PDT / 11:00 EDT / 17:00 CET Etherpad: https://etherpad.wikimedia.org/p/Search_Platform_Office_Hours Google Meet link: https://meet.google.com/vgj-bbeb-uyi Join by phone: https://tel.meet/vgj-bbeb-uyi?pin=8118110806927 Have fun and see you soon! Guillaume -- *Guillaume Lederrey* (he/him) Engineering Manager Wikimedia Foundation <https://wikimediafoundation.org/>

1 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

Discovery