Hello,
Another weekly update from Discovery!
== Highlights ==
* A recent update to the search results page on all wikis - sister project snippets - was deployed into production on June 15; see the email for more info. [0] [1]
* Added a note to the Extension:Kartographer page about mapframe deployments [2]
* Sent out a communication about what the Discovery team's goals and future work will be. [3]
== Discussions ==
=== Search ===
* Logstash scripts are now using curator, and some standard action files (enabling / disabling shard allocation) have been deployed [4]
* Deployed new versions of Wikimedia and other ElasticSearch plugins (epic task with lots of smaller subtasks [5]
* Various updates to getting the search clusters up to ElasticSearch 5.3.2 [6] [7] [8] [9]
* Fixed an issue where the sister project snippets were causing an weird display problem [10]
* We've updated Ukrainian-language wikis with a new Ukrainian language analyzer, which should provide better search results by recognizing related forms of a word. (An example in English would be that searching for "hope", "hoped", "hopes", or "hoping" can all find each other.) [11]
* We've updated Chinese-language wikis using a new Chinese language analyzer, which should provide better search results by doing a better job of breaking up Chinese text into words, and by automatically converting between Simplified and Traditional characters when searching. [12]
We've updated Swedish-language wikis with a smarter configuration that recognizes å, ä, and ö as distinct letters (and not just variants of a and o). [13]
* Setup testing, training and validation splits for learning to rank machine learning [14]
* Worked on calculating the NDCG of click data that feeds the machine learning rank pipeline [15]
=== Wikidata Query Service ===
* Enabled the Mediawiki Service API which allows interacting with Mediawiki API from SPARQL. [16]
* Added more federation endpoints. [17]
=== Analysis ===
* Finalized the migration from Vagrant to Puppet configuration for the dashboards [18]
Investigated a drop in pageviews and clickthroughs on the Wikipedia.org portal - turns out summer is here [19]
* Fixed a minor issue with the desktop and mobile web graphs on the external search dashboard [20]
=== Interactive ===
* Achieved some clarity to the phabricator board with priorities and what is in progress, needs to be in the backlog or stalled. [21]