[Wikitech-l] 2016-12-07 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-12-07 = 2016-12-07 = == Product == === Reading === ==== iOS native app ==== * Last Week ** Shipped 5.3.1 with bug fixes ** Continued work on 5.3.2 - Dynamic text size, data layer update, performance enhancements * This week ** Finish work on 5.3.2, fix bugs from beta feedback ** Feature complete on 5.3.2 Friday 12/9 ==== Android native app ==== * Last week: ** Continuing Q2 goals for Wikidata descriptions ** New beta v2.4.182 *** Fundraising and survey cards now configurable remotely (beta) * Next week (https://phabricator.wikimedia.org/project/view/2352/): ** More Q2 goals for Wikidata descriptions (tutorial and polish) ==== Mobile Content Service (MCS) ==== * Remove obsolete mobile-summary endpoint (handled by RESTBase directly) * Moved to node template version 0.5.0, moved to ES2015 and eslint ==== Reading Web ==== * Current sprint: https://phabricator.wikimedia.org/project/view/2362/ * So far: ** ReadMore has been enabled on Japanese and Spanish wikis (mobile site) ** Wikidata Page banner has been enabled on Finnish Wikivoyage ** Wikidata page descriptions has been enabled on French and German wikipedias (mobile site) ** Lead image has been disabled from the mobile site, beta mode. * Until we meet the next time: ** Create importable test pages that can be used to test various Reading Web related changes ** Hovercards rewrite finish up ** Continue working on returning page images from the lead section only ==== Reading Infrastructure ==== * API i18n changes going out with next train: https://lists.wikimedia.org/pipermail/mediawiki-api-announce/2016-December/… ** you can use the new errorformat, errorlang, errorsuselocal paramers to get localized, parsed errors; if you don't, most API modules will behave the same as before. Exceptions: *** for query modules the error codes won't be prefixed anymore the way parameter names are; *** for a few modules (see announcement) which put errors in some non-default location in the response data, that location might change and/or the contents might change from a single error to an array of errors. * could use some advice from Performance or Language on dealing with huge JS data blobs: *https://phabricator.wikimedia.org/T32574#2836570* <https://phabricator.wikimedia.org/T32574#2836570> * MediaViewer tests failing, mw.language tests seem to be the cause: https://phabricator.wikimedia.org/T152476 === Editing === ==== Collaboration ==== * Working on new filter UI for Special:Recentchanges; a bunch of backend patches for this landed in MW core recently, more will land soon. Will be behind a hidden preference for the time being. * Converted Flow and Echo to extension.json. This has caused a few minor issues for Flow and may cause some for Echo as well. Also, if you have open patches, they'll probably conflict now. * Going to convert PageTriage next; and FlaggedRevs after we clear out the CR backlog a bit there ==== Parsing ==== * Blocked: Tim asked ops for someone to assist him with puppetizing HTML5Depurate for a pilot deployment to the production cluster for our Q2 goal. No response yet. ** See "[Ops] Need Html5Depurate playmate" mail from Tim dated 11/24 * Ongoing investigation of https://phabricator.wikimedia.org/T151702 and followups with Ops and Services * Parsoid deploy today after almost a month ( https://www.mediawiki.org/wiki/Parsoid/Deploymentswill be updated later today) ** Parsoid-native <gallery> rendering + a bunch of other changes going out today (Most interesting for MCS: heading ids now assigned that match core output). ** HTML version bump to 1.3.0; See https://www.mediawiki.org/wiki/Specs/HTML/1.3.0#Changes_since_Specs.2FHTML.… for changes since 1.2.1 * Tim is close to finishing the first version of remex-html ( https://github.com/tstarling/remex-html ) -- a HTML5 parser in PHP === Discovery === * No blockers * Started discussion on how to combine various models of user query enhancements/transformations to improve search results: https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/So_Many_Search_Optio… * Continuing work on crosswiki searches, load test successful * Published analysis of WDQS traffic to detect parallel connections: https://phabricator.wikimedia.org/T149963 * WDQS now limits parallel connections to 5 per IP. Working fine so far. == Technology == === Analytics === * Blocker -- None * Ongoing ** Wikistats 2.0 UI has kicked off with new contractor designer. ** RecentChanges via EventBus is on its way, we will soon have events flowing in Kafka. Purpose is later to turn off Redis based producer. ** Mediawiki history reconstruction is at final review stage (will be long, heavy code) -- Plans to communicate early next quarter ** Old logs on stat1002 have been *deleted*. More at https://phabricator.wikimedia.org/T84618. Now working on removing some old generation processes in the cluster. ** Cross team collaboration in migrating limn editor-engagement dashboards to dashiki === Release Engineering === * '''Blocking''': ** None? * '''Blocked''' ** None * '''Updates''' ** Reminder that deployments are weird between now and the New Year: https://lists.wikimedia.org/pipermail/wikitech-l/2016-November/086936.html ** Gerrit is updating, pretty much right now === Security === * Security Reviews ** Recommendations API continues from last week * Continuing work on CSRF protection for anonymous users ( https://phabricator.wikimedia.org/T40417) * Question for Parsing: Can we limit the amount of nesting in lists? ** https://phabricator.wikimedia.org/T151834 * Question for Reading: Should page requests containing invalid characters in title still result in 200 OK if curid is valid? ** https://phabricator.wikimedia.org/T144100 === Services === * Blockers: none * Updates: ** PDF render service and API endpoint deployed and completely operational: *** https://en.wikipedia.org/api/rest_v1/#!/Page_content/get_page_pdf_title ** Working on followups for the API cluster outage *** https://phabricator.wikimedia.org/T152074 === Technical Operations === * '''Blocked''': ** Community Tech *** https://phabricator.wikimedia.org/T152080 page_assessments creating duplicate key errors * '''Blocking''': ** None * Updates: ** Still working on API cluster failure. https://phabricator.wikimedia.org/T151702 ** new labsdbs are almost ready to start being used ** AB testing design still under discussion https://phabricator.wikimedia.org/T143694 ** Goals for next quarter being drafted, if you have any dependencies on Ops contact us == Wikidata == * I still can not join the Hangout when not being a WMF employee. I know multiple people already looked into this. Please forgive me when I'm not trying any more. I still find the information given in this Etherpad very helpful, and love sharing relevant bits via a WMDE mailing list. ** Grace to look into this ^ * Blocked on security reviews of: ** Cognate extension: https://phabricator.wikimedia.org/T149082 ** InterwikiSorting Extension: https://phabricator.wikimedia.org/T149083 == Fundraising Tech == * Investigating banner impression drop from 08:00-09:00 UTC on 12/1 and 12/2: https://phabricator.wikimedia.org/T152122 * Fixing CiviCRM reports & internal dashboard * Tweaking mailing list export * Planning for next year ** Estimating effort for next year's required payment processor integrations ** Potential extra-curricular work supporting ORES: https://www.mediawiki.org/wiki/User:Adamw/Study_abroad_proposal