[Wikitech-l] 2018-08-01 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-08-01 = 2018-08-01= == Callouts == * SREs say FYI: ** Switchover tentative timeline announced. Please take a look and voice concerns if any Switchover: Services: Tuesday, September 11th 2018 14:30 UTC Media storage/Swift: Tuesday, September 11th 2018 15:00 UTC Traffic: Tuesday, September 11th 2018 19:00 UTC Mediawiki: Wednesday, September 12th 2018: 14:00 UTC Switchback: Traffic: Tuesday, October 9th 2018 19:00 UTC (and maybe some prep work on Monday) Mediawiki: Wednesday, October 10th 2018: 14:00 UTC Services: Thursday, October 11th 2018 14:30 UTC Media storage/Swift: Thursday, October 11th 2018 15:00 UTC * MCR Schema migrations are happening ** Beta is set to write both / read new with no problems identified ** Production set to write both / read old this week ** Starting with migration scripts to copy data from old schema to new one == Audiences == === Readers === ==== iOS native app ==== * Blocked by: - * Blocking: - * Updates: **6.0 in beta ( https://phabricator.wikimedia.org/tag/ios-app-v6.0-walrus-on-a-unicycle/), expected to push another beta this week ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** Maintenance update released to Beta, will go to production tomorrow (Thurs) ** User testing of navigation design prototypes will commence shortly. ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** RFC: Modernise our JavaScript with the goal that the startup module and mediawiki object should not depend on jQuery https://phabricator.wikimedia.org/T200868 ** Mobile website (MinervaNeue / MobileFrontend): *** Page issues UI and instrumentation: T191532 T191303 T197932 T197931 T200867 *** Invest in the MobileFrontend & MinervaNeue frontend architecture: T188261 T197133 T197639 *** Other fixes and hygiene T193172 T200491 T186823 T199282 T199000 T199066 T197110 T198151 ** Product and design are collating research and interviews from Wikimania and working on advanced contributions ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** mobile-html exposed but needs fixes for CSP header and a URL to CSS. Won't run CollapseTable transform on server for the time being. ** Maps: *** New tile regeneration cron job for low-zoom vector tiles https://phabricator.wikimedia.org/T194787 *** Snapshot low DPI bug is waiting for a pull request review from upstream on third party library https://phabricator.wikimedia.org/T152196 *** Working on migrating test servers to Cloud VPS *** Working with SRE (Gehel) on migrating all servers to Debian Stretch ==== Multimedia ==== * No representative today - two team members on vacation and Mark has a conflicting meeting * Updates ** Breaking change in MediaWiki Core OOUI widget nearly caught us out - luckily something else broke in the meantime so the related fatal never occurred because of another fatal. Both fixed now. ** Search for SDC coming along slowly with various people on vacation. ** Next up: OOUI rendering for SDC first feature (captions), coming down the pipeline soon™ ** MCR rollout plan basically set, we'll need some time to sort out our integration, but should all work out well. === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: None * Blocking: None ** Updates: **Unblocked languages on previous issues. ** ==== Parsing ==== * Blocked by: * Blocking: * Updates: ==== Growth ==== * Blocked by: * Blocking: * Updates: ** ==== Language ==== * Blocked by: ** CX patches still blocked from merging due to test failures occuring in Wikibase Lexeme ** Thanks to everyone who helped/are helping to solve issues (4 separate ones) that prevent merging patches to CX&Translate * Blocking: ** Providing guidance on https://phabricator.wikimedia.org/T195910 (ios app language selection related issue) * Updates: ** Grant Metrics enabled for translation in translatewiki.net ** Niklas will work on https://phabricator.wikimedia.org/T195293 (follow-ups to an issue causing an outage a while ago) === Audiences Design === ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** Preparation of OOUI v0.27.6 == Technology == === Analytics === * Blocked by: * Blocking: ** Outage in Eventlogging * Updates: ** Added data quality checks in mediawiki history and mediawiki history reduced datasets ** Cleaning of user directories in hadoop ** Improved data sanitization in Eventlogging (salt creation/rotation) ** Improved partition cleaning in hive === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** Making our exchange rates available on a WMF-visible spreadsheet for travel reimbursement ** Work continues on the ingress scripts for EventLogging data from banner and landing page impressions ** Experimenting with different ways to let donors from certain countries opt in to emails ** CiviCRM: new search filters, looking at mailing house data import bug and data erasure requests ** Reviewing CiviCRM core team code for contact view editor ** More error-handling work prompted by full-scale tests of card processor's new API === MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** Cherry-picked API statsd improvement into production. Updated API dashboard in Grafana. *** https://grafana.wikimedia.org/dashboard/db/api-backend-summary?refresh=5m&a… ** Platform Evolution kick-offs and TechConf prep are ongoing ** Language variants for summary REST API deployed - Page Previews will now show your preferred variant *** Only serbian language is supported now, but more will be added as Parsoid supports more conversions ** Memory issues with EventStreams service in codfw affected other services, now resolved. == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** MCR Schema migrations are happening *** Beta is set to write both / read new with no problems identified *** Production set to write both / read old this week *** Starting with migration scripts to copy data from old schema to new one ** Discussion on-going on whether a production test wiki is necessary in addition to a test wiki on beta: https://phabricator.wikimedia.org/T197616 *** Requires Wikibase change propagation ** Development and code review continues === Performance === * Blocked by: ** * Blocking: ** * Updates: ** === Release Engineering === * Blocked by: ** Related to 1.32.0-wmf.14 train https://wikitech.wikimedia.org/wiki/Incident_documentation/20180724-Train#A… *** Feedback needed from Wikidata team on how T200340 (*Wikibase\DataModel\Entity\EntityIdParsingException $serialization must not be an empty string*) could be prevented. *** Feedback needed from Readers/Performance team(s) on how T200346 (*wmf.14 failing to execute ThumbnailRender jobs "error: ThumbnailRenderJob::run: HTTP request failure"*) could be prevented. *** Feedback needed from ORES/Wikidata team(s) on how T200412 (*PageTriage requires ORES to be installed*) could be prevented. *** Feedback needed from Wikidata team on how T200420 (*Wikidata dispatching stuck (not releasing lockmanager locks)*) could be prevented. *** Feedback needed from Readers team on how T200456 (*MapCacheLRU::has called with invalid key. Must be string or integer*) could be prevented. * Blocking: * Updates: ** Moved the beta deployment server to deployment-deploy01, yell if anything seems amiss there === Research === * Blocked by: None * Blocking: None * Updates: ** We've been analyzing the Citation usage data and improving the schema. - https://phabricator.wikimedia.org/T199457 ** Working on recommending missing articles based on translation pageview predictions. ** Have been interviewing candidates for a research position. === Scoring Platform === * Blocked by: ** Waiting for a TechCom review of JADE proposal for deployment. *** Trying to get Global Collaboration's attention about this. *** "Everything is a wiki page", yet we're not allowed to deploy an extension that might increase the number of wiki pages... Who will be blocked next? * Blocking: * Updates: ** GSoC project by Saurabh Batra to identify donations fraud has resulted in a successful model! We're beginning integration work now. === Search Platform === * Blocked by: * Blocking: * Updates: ** Lexeme fulltext search merged: https://phabricator.wikimedia.org/T196188 ** Started collecting click stats for Wikidata completion search: https://phabricator.wikimedia.org/T196186 ** Quality constraints violations are now in WDQS: https://phabricator.wikimedia.org/T172380 ** Fixed intitle search not matching stopwords: https://phabricator.wikimedia.org/T68969 ** Fixed problems in completion search on shard failure: https://phabricator.wikimedia.org/T180807 ** Added task to purge query click data according to privacy policy: https://phabricator.wikimedia.org/T189845 ** Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654 ** Working on ES 6.3 upgrade: https://phabricator.wikimedia.org/T197960 ** Working on Esperanto analyzer: https://phabricator.wikimedia.org/T200099 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** eqiad row B and C upgrades went quite fine with some minor hiccups ** work on the switchover preparation ongoing. Tentative timeline posted. Take a look at calls out section == Wikidata == * Blocked by: * Blocking: ** ContentTranslation CI red because of failing Wikidata-related tests: https://phabricator.wikimedia.org/T200693 *** working on understanding and fixing failures * Updates: ** Work in Lexicographical data continues: *** adding senses *** improving the editor workflow *** https://phabricator.wikimedia.org/project/view/2292/ == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == SoS Meeting Bookkeeping == * Updates: ** move the meeting to 2 hours earlier as soon as week of 2018-08-06- look for new invite! ** some changes to the notes template ** keep the meeting as is- a forum for teams to share updates and ask for help and keep the notes as useful as possible ** decision to handle goals dependencies outside this meeting