Hello, This is the weekly update from the Search Platform team for the week starting 2019-07-15.

As always, feedback and questions are welcome.

== Discussions ==

=== Search === * Search of wikidata string property values using haswbstatement is case sensitive - after a bit of discussion, we added a patch for adding a case-insenstitive subfield for statement field [0], and re-indexing happened (with a minor issue) to get it into production [1] * Implemented support for haslabel:* [2] * We received a request to delete search indices for now-deleted zerowiki from production and did the needful [3] * Glent work: create oozie workflow for glent m0 prep has been finished [4] * The team did some work with the Multimedia team to index captions as description fields not label [5] * David worked on adapting IndexLookupFallbackMethod for glent requirements [6] * The team worked on evaluating DYM metrics that are available in current search satisfaction logging [7] with a follow up in [8] ** Metrics we should use moving forward *** % of search shown a [auto / non-auto] dym **** Target: Increase % without significantly reducing the other metrics *** % of people shown non-auto dym that click through to dym results **** Target: Increase % of clickthrough *** % of searches shown dym search results [auto / non-auto] dym results that clicked a result **** Target: Increase % of clickthrough * There was a bug where there was an unexpected result set returned by Elasticsearch [9], we went ahead and closed it because it looks like the same root cause is fixed in [10] * CirrusSearch will now provide a query dispatcher (once the train finishes week of July 30) [11] * We did a spike: load search data into turnilo to test whether exploratory data can do away with some of the dashboards and decided that with respect to our 'did you mean' suggestions and this seems like a plausible path forward [12] * WikibaseLexemeCirrusSearch started to fail for no particular reason (seems to be due to missing class exported by WikibaseLexeme) and will be fixed in this week's train (July 30) [13]

=== Wikidata Query Service === * Finished reindexing database [14] which fixes resource problems with WDQS [15] * Wikidata RDF dumps no longer have BETA marker [16] * Fixed continuation support for MWAPI in WDQS [17] * Implemented support for wdtn: prefix for WDQS GUI [18] * Fixed incorrect VIAF URIs in WDQS data [19] * Implemented support for ChronologyProtection in WDQS Updater [20] * Refactored label service to support more complex queries [21]

=== Portal === * The weekly update to the wikipedia.org portal had been failing for a few weeks, Hashar helped out and fixed it, thanks! [22], but we still have another ticket to be fixed [23]

[0] https://phabricator.wikimedia.org/T206613 [1] https://phabricator.wikimedia.org/T227136 [2] https://phabricator.wikimedia.org/T224611 [3] https://phabricator.wikimedia.org/T227718 [4] https://phabricator.wikimedia.org/T216783 [5] https://phabricator.wikimedia.org/T226722 [6] https://phabricator.wikimedia.org/T227262 [7] https://phabricator.wikimedia.org/T228226 [8] https://phabricator.wikimedia.org/T216058 [9] https://phabricator.wikimedia.org/T220637 [10] https://phabricator.wikimedia.org/T228063 [11] https://phabricator.wikimedia.org/T216429 [12] https://phabricator.wikimedia.org/T216058 [13] https://phabricator.wikimedia.org/T229215 [14] https://phabricator.wikimedia.org/T228122 [15] https://phabricator.wikimedia.org/T213210 [16] https://phabricator.wikimedia.org/T226153 [17] https://phabricator.wikimedia.org/T209034 [18] https://phabricator.wikimedia.org/T205777 [19] https://phabricator.wikimedia.org/T218522 [20] https://phabricator.wikimedia.org/T212550 [21] https://phabricator.wikimedia.org/T175840 [22] https://phabricator.wikimedia.org/T228639 [23] https://phabricator.wikimedia.org/T213806

----

Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update.

https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly

The archive of all past updates can be found on MediaWiki.org:

https://www.mediawiki.org/wiki/Discovery/Status_updates

Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator.

[1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R

Yours, Chris Koerner (he/him) Community Relations Specialist Wikimedia Foundation