This is the weekly update from the Search Platform team for the week starting 2018-10-22. As always, feedback and questions welcome. == Discussions == === Search === * Mathew and Gehel worked on refactoring the WDQS updater while also increasing the restart interval of the WDQS updater [0] [1] *There were some known issues that the Search team helped in fixing where the Elasticsearch puppet config changes broke puppet in various instances [2] *Erik fixed an issue where the sister search / cross language search interaction with multi-datacenter was a bit off [3] *The team worked on getting Debian Stretch off of Ubuntu Trusty for all instances of the search project [4], as well as various other updates needed to get ElasticSearch ready for version 6: as well as investigating just how many number of servers we really need in the ElasticSearch cluster. [5] [6] [7] [8] [9] *Gehel and Mathew also worked on |modifing scap::target to define sudo rules for multiple services [10] *Erik |fixed a failure where cirrusSearchIncomingLinkCount was getting a 'read timeout is reached' issue from title::getFirstRevision [11] *Erik finished up work to add autocomplete evaluation via MRR to relforge [12] == Other Noteworthy Stuff == * Oct 18-21 Trey went to WikiConferenceNA 2018. [13] Some highlights: ** He was interviewed [14] for the Wikijabber podcast. [15] ** He gave a lightning talk on homoglyphs. Slides are available online. [16] ** You can see the full conference schedule online [17] and find the slides for many of the presentations on Commons. [18] ** More detailed write up on MediaWiki. [19] == Did you know? == * Homoglyphs [20] are characters in different writing systems that look very similar or, in some fonts, even identical to each other. For example A/Α/А or M/Μ/М in Latin, Greek, and Cyrillic, respectively. Homoglyphs can be very hard to detect when reading, but they interfere with search because “Мoscow” and “Moscow” are completely different words from the point of view of search. The former starts with a Cyrillic M (as does Moscow’s name in Russian, “Москва”). There are often a few dozen examples of the mixed-script “Мoscow” [21] on English Wikipedia at any given time. (Trey cleans them up from time to time as a hobby, and hopes to create a plugin for Elasticsearch to automatically make them visible to search.) [0] https://phabricator.wikimedia.org/T208392 [1] https://phabricator.wikimedia.org/T207843 [2] https://phabricator.wikimedia.org/T205672 [3] https://phabricator.wikimedia.org/T205558 [4] https://phabricator.wikimedia.org/T204686 [5] https://phabricator.wikimedia.org/T206468 [6] https://phabricator.wikimedia.org/T206469 [7] https://phabricator.wikimedia.org/T206472 [8] https://phabricator.wikimedia.org/T206470 [9] https://phabricator.wikimedia.org/T207724 [10] https://phabricator.wikimedia.org/T206314 [11] https://phabricator.wikimedia.org/T206042 [12] https://phabricator.wikimedia.org/T205494 [13] https://wikiconference.org/wiki/2018/Main_Page [14] https://wikijabber.com/wikijab015-trey-jones/ [15] https://wikijabber.com/ [16] https://docs.google.com/presentation/d/1nQQUJ8W4NK4vf7WbKFp2YZz3Bvej97zRFO4… [17] https://wikiconference.org/wiki/2018/Schedule [18] https://commons.wikimedia.org/wiki/Category:WikiConference_North_America_20… [19] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/WikiConference_North… [20] https://en.wikipedia.org/wiki/Homoglyph [21] https://en.wikipedia.org/w/index.php?search=%D0%9Coscow&title=Special%3… ---- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation