[discovery] Discovery Weekly Update for the week starting 2016-12-05

This is the weekly update for the week starting 05 December. As always, feedback and questions are welcome. ==Highlights== * Load tests for cross-project searching were completed successfully. [0] We are now testing how many results are produced for typical queries as a first step towards figuring out how relevant the results are. [1] * Released tabular and map data namespaces to Commons, after reviewing implementation, consulting legal, enabling shared geojson data storage, and adding metrics tracking. [2] [3] [4] [5] [6] [7] [8] [9] === Search === * We've put together a draft proposal for how to deal with the interaction of all the possible additional search options—suggestions, quote-stripping, "wrong keyboard", language ID, etc.—to have a more co-ordinated conversation about all this. Comments on the talk page there are welcome. [10] * Load tests for cross-project searching were completed successfully. [11] We are now testing how many results are produced for typical queries as a first step towards figuring out how relevant the results are. [12] * Upgraded to Java 8 in preparation for upgrading ElasticSearch next quarter. [13] * Performed some refactoring to improve interwiki searching. [14] * Improved handling of characters containing diacritics or accents. [15] [16] * Added support for minimum query length to detect the language of the query. When a minimum length is eventually chosen, this will solve edge cases where some very short queries and queries consisting just of numbers could produce unexpected results. [17] * Fixed an edge case where third-party users of CirrusSearch could get an exception when building a completion suggester index. [18] === Analysis === * Fixed an error with installing R package Boom (& bsts) on stat1002 (but can on stat1003) [19] === Portal === * Add node 6 compatibility to Portal build tasks [20] === Interactive === * Enhance Report Updater to be able to send data to graphite [21] * Increase user sampling rate [22] * Investigate ClearTables [23] * Bug fixed: Closing maps by going back doesn't always work [24] * Updated and adapted Tabular Data to match published formats [25] * Updated Legal wording update for tabular and map data release [26] * Added information on how to change error message [27] * Updated the logging for Kartotherian from info to warn [28] == Other Noteworthy Stuff == * Published Wikimedia Discovery's narrative and roadmap for FY 2016/17 (July 2016 - June 2017) [29] [0] https://phabricator.wikimedia.org/T149740 [1] https://phabricator.wikimedia.org/T151935 [2] https://phabricator.wikimedia.org/T148745 [3] https://www.mediawiki.org/wiki/Help:Tabular_Data [4] https://www.mediawiki.org/wiki/Help:Map_Data [5] https://www.mediawiki.org/wiki/Extension:JsonConfig/Tabular [6] https://phabricator.wikimedia.org/T134426 [7] https://phabricator.wikimedia.org/T152553 [8] https://phabricator.wikimedia.org/T137930 [9] https://phabricator.wikimedia.org/T152661 [10] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/So_Many_Search_Optio… [11] https://phabricator.wikimedia.org/T149740 [12] https://phabricator.wikimedia.org/T151935 [13] https://phabricator.wikimedia.org/T151325 [14] https://phabricator.wikimedia.org/T141033 [15] https://phabricator.wikimedia.org/T137830 [16] https://phabricator.wikimedia.org/T146402 [17] https://phabricator.wikimedia.org/T149318 [18] https://phabricator.wikimedia.org/T150799 [19] https://phabricator.wikimedia.org/T147682: [20] https://phabricator.wikimedia.org/T150190 [21] https://phabricator.wikimedia.org/T150187 [22] https://phabricator.wikimedia.org/T152174 [23] https://phabricator.wikimedia.org/T141964 [24] https://phabricator.wikimedia.org/T151915 [25] https://phabricator.wikimedia.org/T152184 [26] https://phabricator.wikimedia.org/T152553 [27] https://phabricator.wikimedia.org/T152554 [28] https://phabricator.wikimedia.org/T148116 [29] https://www.mediawiki.org/wiki/File:Discovery_narrative_FY_2016-17.pdf ---- The full update, and archive of past updates, can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as Easy or Volunteer needed in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation