Good to see you,
This is the weekly update from the Search Platform team for the week
starting 2019-03-04.
As always, feedback and questions are welcome.
== Discussions ==
=== Search ===
* We've updated Textcat with the new Russian wrong-keyboard and
wrong-encoding models and now need CirrusSearch to be up to date as well [0]
* In order to ease migration to ES6 we should migrate to 5.6.14 first (epic
task is now completed) [1]
** As part of the ES6 update, we needed to upgrade logstash and the
logstash elasticsearch cluster to 5.6.14 [2]
** We also upgraded logstash plugin to 5.6.14 as part of the prep for
elasticsearch upgrade [3]
* We've deployed & tested WikibaseCirrusSearch on beta cluster [4]
* We've also deployed & tested WikibaseCirrusSearch on testwikidata and
found things to be good! [5]
* We found that incigna monitoring for Elasticsearch doesn't seem to notice
when an out-of-memory error has happened on a node — this will be fully
fixed with the next cluster restart [6]
* There was some logspam due to deduplicating I18N messages between
Wikibase and WikibaseCirrusSearch that we resolved [7]
* A discovery was made with a WMFTimeoutException in Special:Search that
was resolved by decreasing timeouts and removing our timeout hack for
regexes [8]
* An umbrella task to track patches of merge commits to activate elastic6
support code [9]
* A ticket created way back in 2016 asked: 'the new substring search is
great on mw.o. Can we have it on office wiki too?' and yes, now it is [10]
=== Wikidata Query Service ===
* We've created CI testing environment for Blazegraph on our Jenkins CI [11]
* Working on hiring a contractor to help us with Blazegraph tasks [12]
* We noticed that metrics from wdqs updater JMX should be prefixed while we
were investigating something else, metrics exposed by jmx_exporter running
on wdqs-updater should be prefixed with wdqs_updater_ to make it more clear
what they are referring to (done!) [13]
== Other Noteworthy Stuff ==
* Read Trey's new blog post about 'the anatomy of search: a place for my
stuff' [14]
[0]
https://phabricator.wikimedia.org/T216083
[1]
https://phabricator.wikimedia.org/T215931
[2]
https://phabricator.wikimedia.org/T216052
[3]
https://phabricator.wikimedia.org/T216993
[4]
https://phabricator.wikimedia.org/T215684
[5]
https://phabricator.wikimedia.org/T217276
[6]
https://phabricator.wikimedia.org/T76090
[7]
https://phabricator.wikimedia.org/T216839
[8]
https://phabricator.wikimedia.org/T216860
[9]
https://phabricator.wikimedia.org/T217043
[10]
https://phabricator.wikimedia.org/T150153
[11]
https://phabricator.wikimedia.org/T216855
[12]
https://phabricator.wikimedia.org/T200558
[13]
https://phabricator.wikimedia.org/T208215
[14]
https://wikimediafoundation.org/2019/03/12/the-anatomy-of-search-a-place-fo…
----
Subscribe to receive on-wiki (or opt-in email) notifications of the
Discovery weekly update.
https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly
The archive of all past updates can be found on
MediaWiki.org:
https://www.mediawiki.org/wiki/Discovery/Status_updates
Interested in getting involved? See tasks marked as "Easy" or
"Volunteer needed" in Phabricator.
[1]
https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R
[2]
https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R
Yours,
Chris Koerner (he/him)
Community Relations Specialist
Wikimedia Foundation