A belated greetings,
This is the weekly update from the Search Platform team for the week
starting '''2018-09-03''' and
'''2018-09-10'''
== Highlights==
* New blog post: The anatomy of search: Variation under nature - "This
is the second in a series of blog posts giving a basic overview of how
full-text search engines work, with a bit of extra attention for some
interesting language-specific issues. Our topic for today is how we
normalize the words we found in our text during the previous step,
tokenization." [0]
== Discussions ==
=== Search ===
* Trey finished up the Esperanto analysis, stemmer updates and
reindexing of the wikis [1], [2], [3]
* Erik tackled a lot of small bugs that will be in production the week
of Sep 18th: redirect showing irrelevant info [4], strings starting
with a # sign were redirecting to main page [5], error when using
double quotes in the category or title [6], "close redirects" in error
messages [7], UI issue where 'results 1 of 2' is displayed when only
one result is found [8]
* Mathew fixed an issue with alerting for when Elasticsearch has
shards larger than the maximum size [9]
* Erik worked on getting CirrusSearch to gracefully handle missing
plugin sections in the ElasticSearch response [10]
* Gehel and Erik did some Mjolnir query daemon monitor work [11], [12]
* Trey fixed an issue where empty strings caused by ICU folding in
ElasticSearch were getting indexed [13]
* The work for using Kafka for communicating between the analytics
cluster and elasticsearch has finished [14]
=== Wikidata Query Service ===
* Diskspace upgrade has been finished
* Categories are now updated daily in WDQS from daily diffs [15]
[0]
https://wikimediafoundation.org/2018/09/13/anatomy-search-variation-under-n…
[1]
https://phabricator.wikimedia.org/T202173
[2]
https://phabricator.wikimedia.org/T202662
[3]
https://phabricator.wikimedia.org/T203005
[4]
https://phabricator.wikimedia.org/T190010
[5]
https://phabricator.wikimedia.org/T182452
[6]
https://phabricator.wikimedia.org/T73123
[7]
https://phabricator.wikimedia.org/T191485
[8]
https://phabricator.wikimedia.org/T71382
[9]
https://phabricator.wikimedia.org/T203546
[10]
https://phabricator.wikimedia.org/T191493
[11]
https://phabricator.wikimedia.org/T199732
[12]
https://phabricator.wikimedia.org/T200740
[13]
https://phabricator.wikimedia.org/T192502
[14]
https://phabricator.wikimedia.org/T198490
[15]
https://phabricator.wikimedia.org/T201217
----
Subscribe to receive on-wiki (or opt-in email) notifications of the
Discovery weekly update.
https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly
The archive of all past updates can be found on
MediaWiki.org:
https://www.mediawiki.org/wiki/Discovery/Status_updates
Interested in getting involved? See tasks marked as "Easy" or
"Volunteer needed" in Phabricator.
[1]
https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R
[2]
https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R
Yours,
Chris Koerner
Community Relations Specialist
Wikimedia Foundation