[Wikitech-l] 2016-05-25 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-25 = 2016-05-25 = == Technology == === Analytics === - Trying to puppetize druid, harder than it looks - Working on scaling on pageview API and cassandra, doing perf testing on new nodes - Trying to add throttling to pageview API - Working on harvesting edit data from db/dumps into hadoop, WIP , main goal this quarter - Deployed visualization of Unique Devices: https://vital-signs.wmflabs.org/#projects=ptwiki/metrics=UniqueDevices - === Services === * RESTBase ** rate limiting in prod, log-only *** Analytics, we need to discuss pageview limits * Cassandra ** expanding from 2 to 3 instances per node in prod ** upgrade to 2.2.6 next * Change prop ** handling updates for summary and mobile-sections* endpoints ** will move purging to it soon * Math ** MathML by default on all wikibooks, early next week all projects * heads up: Services team on Wikimania, then off-site at the end of June === Release Engineering === * '''Blocking''': ??? * '''Blocked''': none * '''Updates''': ** wmf.3 is rolling forward this week ** rc.0 of 1.27 should be out this week === Technical Operations === * '''Blocking''': ** none * '''Blocked''': ** none * Updates: ** misc varnish cluster on route for being upgrade to varnish 4 again ** getting rid of tech debt on the database front (m1 cluster to be reimaged) ** helping releng with scap3 ** Getting finally a redundant link esams-eqiad ** libicu upgrade. See email from Giuseppe on wikitech-l === Security === * Two-factor authentication has been deployed to CentralAuth wikis with permission enabled for staff * Abbey and Daisy are assisting in usability surveying of two-factor * Darian and Chris are working on knowledge transfer prior to Chris' last day on Friday, May 27th * Darian is working on onboarding documentation in anticipation of Security Team hires in the near-ish future * Security review schedule remains on track ( https://www.mediawiki.org/wiki/Wikimedia_Security_Team/Schedule ) and Brian Wolff will be assisting == Product == === Reading === ==== Web ==== * Getting ready for Hovercards A/B test (finialising bug fixes) ** Fundraising tech eng can have a look at JS variable for Popups enabled/disabled ==== Android ==== * released Beta with Reading Lists ==== iOS ==== ==== Mobile Content Service ==== * Working on feed endpoints ==== Reading Infrastructure === * AuthManager: please read email from Brad on wikitech-l * https://gerrit.wikimedia.org/r/#/c/290269 (testing gem) pending review as of 24-May-2016 === Community Tech === * No blockers * Numerical sorting in categories ** New indexes are in place thanks to JCrespo ( https://phabricator.wikimedia.org/T130692 ) ** Will be proposing on Wikitech-l that we switch to "uca-default" as the default page collation, rather than "uppercase" ( https://phabricator.wikimedia.org/T136113 ) * Launched MassViews interface for pageview stats ( http://tools.wmflabs.org/massviews/ ) * Working on new CopyPatrol tool for detecting plagiarism ( http://tools.wmflabs.org/plagiabot ) === Editing === ==== Parsing ==== (Subbu won't be there, updates only) * Work ongoing to migrate Parsoid to use service-runner after a bunch of fixes were pushed to service-runner - hoping to push this past the finish line by next week before attempting a migration of Parsoid cluster to jessie / node v4 (Follow along on https://phabricator.wikimedia.org/T135176 and blocking tasks). Conversation ongoing with services team to resolve details. * Tidy replacement work proceeding well. After last round of fixes and visual diff testing, ~88% of test pages render with pixel-perfect accuracy and ~97% pages with < 1% pixel diffs with HTML5depurate. Additional CSS fixes since then and new round of visual diff testing in progress. Tim working to make some fixes to doBlockLevels in core parser to iron out some kinks there which leads to different behavior in HTML5depurate compared to Tidy (similar effects in Parsoid). * Kunal's linker rewrite patch merged. Follow up work in progress to use the new linker code. * VE / CX: Please start thinking about how your code needs to change to use split data-mw format. The data-mw split code is probably 2-3 weeks away in terms of being ready for deployment, but you can start testing it with Parsoid master which can provide you the split data-mw (ping arlolra on IRC for details). ==== Language ==== * Blocked: ** Preference section "Internationalisation" balloons after clicking "More language settings" https://phabricator.wikimedia.org/T133114(Frontend/Style libs) ** Can't load In Progress or Published translation list https://phabricator.wikimedia.org/T135743 (For: Collobration/Roan) * Updates: ** Compact Language Links (as a non-beta feature) deployed in Beta/testwikis; work on it continue along with ULS === Fundraising tech === * (force) merged security patches to fr branch, deployed ** got tests passing again Monday * CentralNotice: api for a/b testing * More work to get off ActiveMQ, remove SPOF (just bit us again last week) * Prepping for fundraising in Israel, Japan and Ukraine ** Trying to mess with language fallbacks on payments cluster so we never show Russian messages to those whose preferred language is Ukrainian * Enhancing fraud & dos mitigation measures === Discovery === * '''Blocking''': none * '''Blocked''': none * Team offsite last week, got plans for next Q and year * Upgrade to ElasticSearch 2.3 is coming on Thursday ( https://phabricator.wikimedia.org/T133124) * Portal team added descriptive texts to project links on portal after A/B test showed (small) positive impact * Survey results for portal visitors: https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Survey_-_May_2016.… * Maps in Wikivoyage now support external layers: https://en.wikivoyage.org/wiki/Wikivoyage:Travellers%27_pub#Maps_with_extra… == Wikidata == * Blockers: none. * Deleting files on Commons that are used in Wikidata statements was not possible due to a bug. https://phabricator.wikimedia.org/T135485 * First prototype for structured data on Commons is close, finally. https://phabricator.wikimedia.org/T125822 * QUnit tests timed out on Jenkins more often this week. Anybody knows why? https://phabricator.wikimedia.org/T136303