Greetings,
This is the weekly update from the Search Platform team for the week starting 2019-04-08.
As always, feedback and questions are welcome.
== Discussions ==
=== Search === * New WikibaseCirrusSearch code is deployed and enabled on all wikis, including Wikidata & Commons. [0] *We re-indexed all Greek, Turkish, and Irish-language wikis with better handling of Greek accents [1], Turkish İ/ı [2], and Irish initial mutation [3] when lowercasing searches in quotes. [4] * We noticed that indices can move to readonly state when disk space is low and needs to be reset manually once disk space is available again, so we made it a cookbook [5] * David wrote a patch to help with an exception from CirrusSearch/Sanity/Checker (cannot fetch ids from index) [6] * We fixed/finalized more things with the ES6 upgrade: ** Create checks that alerts on cirrussearch update lags [7] ** Elasticsearch 6: the classic similarity is deprecated [8] ** Setup elasticsearch on cloudelastic100[1-4] [9] ** Rack/setup/install cloudelastic100[1-4].eqiad.wmnet systems [10] * Erik converted mjolnir from KafkaRDD to direct kafka-python usage, because KafkaRDD in pyspark only supports the 0.8 api [11]
=== Wikidata Query Service === * Deployed patch to fix an issue in Blazegraph workbench [12] * Working on improving cache behavior of Updater [13]
[0] https://phabricator.wikimedia.org/T218954 [1] https://en.wikipedia.org/wiki/Greek_diacritics#Accents [2] https://en.wikipedia.org/wiki/Dotted_and_dotless_I [3] https://en.wikipedia.org/wiki/Irish_initial_mutations [4] https://phabricator.wikimedia.org/T217806 [5] https://phabricator.wikimedia.org/T219799 [6] https://phabricator.wikimedia.org/T218945 [7] https://phabricator.wikimedia.org/T219601 [8] https://phabricator.wikimedia.org/T219268 [9] https://phabricator.wikimedia.org/T214921 [10] https://phabricator.wikimedia.org/T194186 [11] https://phabricator.wikimedia.org/T219932 [12] https://phabricator.wikimedia.org/T219406 [13] https://phabricator.wikimedia.org/T217897
----
Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update.
https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly
The archive of all past updates can be found on MediaWiki.org:
https://www.mediawiki.org/wiki/Discovery/Status_updates
Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator.
[1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R
Yours, Chris Koerner (he/him) Community Relations Specialist Wikimedia Foundation