Greetings,
This is the weekly update from the Search Platform team for the week
starting 2019-04-08.
As always, feedback and questions are welcome.
== Discussions ==
=== Search ===
* New WikibaseCirrusSearch code is deployed and enabled on all wikis,
including Wikidata & Commons. [0]
*We re-indexed all Greek, Turkish, and Irish-language wikis with
better handling of Greek accents [1], Turkish İ/ı [2], and Irish
initial mutation [3] when lowercasing searches in quotes. [4]
* We noticed that indices can move to readonly state when disk space
is low and needs to be reset manually once disk space is available
again, so we made it a cookbook [5]
* David wrote a patch to help with an exception from
CirrusSearch/Sanity/Checker (cannot fetch ids from index) [6]
* We fixed/finalized more things with the ES6 upgrade:
** Create checks that alerts on cirrussearch update lags [7]
** Elasticsearch 6: the classic similarity is deprecated [8]
** Setup elasticsearch on cloudelastic100[1-4] [9]
** Rack/setup/install cloudelastic100[1-4].eqiad.wmnet systems [10]
* Erik converted mjolnir from KafkaRDD to direct kafka-python usage,
because KafkaRDD in pyspark only supports the 0.8 api [11]
=== Wikidata Query Service ===
* Deployed patch to fix an issue in Blazegraph workbench [12]
* Working on improving cache behavior of Updater [13]
[0]
https://phabricator.wikimedia.org/T218954
[1]
https://en.wikipedia.org/wiki/Greek_diacritics#Accents
[2]
https://en.wikipedia.org/wiki/Dotted_and_dotless_I
[3]
https://en.wikipedia.org/wiki/Irish_initial_mutations
[4]
https://phabricator.wikimedia.org/T217806
[5]
https://phabricator.wikimedia.org/T219799
[6]
https://phabricator.wikimedia.org/T218945
[7]
https://phabricator.wikimedia.org/T219601
[8]
https://phabricator.wikimedia.org/T219268
[9]
https://phabricator.wikimedia.org/T214921
[10]
https://phabricator.wikimedia.org/T194186
[11]
https://phabricator.wikimedia.org/T219932
[12]
https://phabricator.wikimedia.org/T219406
[13]
https://phabricator.wikimedia.org/T217897
----
Subscribe to receive on-wiki (or opt-in email) notifications of the
Discovery weekly update.
https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly
The archive of all past updates can be found on
MediaWiki.org:
https://www.mediawiki.org/wiki/Discovery/Status_updates
Interested in getting involved? See tasks marked as "Easy" or
"Volunteer needed" in Phabricator.
[1]
https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R
[2]
https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R
Yours,
Chris Koerner (he/him)
Community Relations Specialist
Wikimedia Foundation