[Wikitech-l] 2016-07-06 Scrum of Scrums meeting notes

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-07-06 = 2016-07-06 = == Product == === Reading === ==== iOS ==== * 5.0.5 has been delayed for 2 more weeks due to new regressions. ** We are restarting the entire beta process because the 5.0.5 release diverged significan;ty from the trunk ** A new 5.0.5 with changes more recent bugfixes from the main trunk is being redeployed to beta this week ** 5.0.5 will re-enter regression next week * 5.1 features are being re-evaluated due to the long development time of 5.0.5 ** Some 5.1 features will likely be moved to 5.2 * Discovery is helping us improe the map UI first developed on Android by implementing some Geodata API enhancements ( https://phabricator.wikimedia.org/T139378) ==== Android ==== Finishing touches on the feed. ==== Mobile Content Service ==== * Experienced more than a dozen Nagios checker failures (timeouts) due to increased memory usage by ORES last weekend. Got fixed on Monday. https://phabricator.wikimedia.org/T139177 * Feed endpoint improvements: * redirect to summary endpoint for random and TFA if possible. https://phabricator.wikimedia.org/T139424 + https://phabricator.wikimedia.org/T136960 * adding date input validation for feed endpoints which accept dates Blocked on Services team: * We need the public feed endpoints (aggregated feed + random page) to enable the feed functionality for a beta Android app release. This is blocking the Android teams quarterly goal. ==== Reading Web ==== * Wikidata descriptions to mobile web stable in ca.wiki and pl.wiki * Deployed lazy references and images to mobile web tl.wiki * Fixing some bugs with hovercards to improve data analysis from A/B test * Started working in improvements to language switcher in mobile web ==== Reading Infrastructure ==== === Community Tech == * Deploying PageAssessments extension to test.wikipedia ( https://www.mediawiki.org/wiki/Extension:PageAssessments) * Finishing work on CopyPatrol Tool (https://tools.wmflabs.org/copypatrol) ** Replication lag on Tool Labs has been a major problem. We are migrating from local DB queries to API requests to avoid the problem. * Figuring the out the best implementation plan for switching to UCA collation + numerical sorting for categories * No blockers === Editing === ==== Multimedia ==== * https://phabricator.wikimedia.org/T138273#2410743 MatmaRex needs review from *anomie, tgr, and AaronSchulz*. * Still waiting for Thumbor deployment to carry ImageTweaks forward, Gilles says he's working on Debian packaging * Continuing work on FileAnnotations * Continuing work on getting rid of fatal errors in UploadWizard ==== Collaboration ==== * Blocking - No change * Blocked - None * Updates ** Deployed to group 0 new enhanced Echo bunding (with the ability to expand and collapse bundles of notifications and act on individual notifications), changed sorting of Alerts and Messages ** Deployed new version of Special:Notifications with per-page notification lists ==== Parsing ==== * Co-ordinating with Services to resume work on Parsoid migration to use service-runner utility. This blocks upgrade of parsoid production cluster to node 4.x (from 0.10) and deployment process to scap3 (from trebuchet) * Continuing to work on a bunch of bug fixes in Parsoid. * Work ongoing (Tim & Scott) to land a PHP HTML5 parser in core which can serve as a default Tidy replacement solution for mediawiki. == Wikidata == * Focus on refactoring the Sites mess in core, starting with: https://phabricator.wikimedia.org/T137537, tracked in: https://phabricator.wikimedia.org/T113034 * Core support for multilingual wikis: https://phabricator.wikimedia.org/T114640 * Ongoing communication about Multi Content Revision support in core: https://phabricator.wikimedia.org/T107595 == Technology == === Analytics === * Will start working on migrating refinery to SCAP 3 tomorrow (cc: release team) * Ongoing work on Event Bus, scaling AQS and the Pageview API, reconstructing mediawiki history, and loading Druid with pageview data === Research === * ores.wikimedia.org online (woo ops). ores.wmflabs.org will remain online and a deprecation plan will be announced "soon" * Major ORES downtime was exacerbated by icinga config failure (301 is a good response and not followed by default) https://wikitech.wikimedia.org/wiki/Incident_documentation/20160610-ORES * ORES extension deployed to fawiki and wikidatawiki. Large wikis coming soon. === Security === * Other security reviews are being schedule; if you have need, please submit your request: https://www.mediawiki.org/wiki/Wikimedia_Security_Team/Security_reviews * A security release will be prepared soon * Reviews: 3d2png (cont.), Tool Labs Console === Services === * out for two weeks - Wikimania + Offsite ** lots of interesting discussions * Auth / session storage service ** discussed the plan with Darian ** will draft an Arch RfC soon * Nodejs migration to 4.4.6 ** https://phabricator.wikimedia.org/T138561 ** scheduled for next wednesday ** test your services and update your package.json to use node v4.4.6 ** especially important for SCB services === Fundraising tech === * Building and deploying new payments servers to get off precise and php 5.3 * Also upgrading mediawiki and CiviCRM, planning how we'll more closely follow mw master * More work towards de-duplicating donor database * CentralNotice: don't load anything on Special: or action=edit * Still investigating what looks like missing log entries (delivered via Kafkatee): https://phabricator.wikimedia.org/T132500 === Discovery === * '''Blocking''': none * '''Blocked''': none * Hired new data analyst, she starts end of July * TextCat A/B finished, analyzing results * Working on enabling boxed search by coordinates with near: and neartitle: - https://gerrit.wikimedia.org/r/#/c/297524/ * Logstash elasticsearch upgrade planned for July 7th ( https://phabricator.wikimedia.org/T136001). This also includes upgrade to Kibana 4. * Portal stats updated on June 30th * Portal survey on why people come to Portal are published: https://phabricator.wikimedia.org/T136874#2418095 ==== Maps/Graphs ===== * Geoshapes service is integrated with WDQS and can provide both wikidata data and shapes: http://data.wmflabs.org/wiki/Regional_maps === RelEng === * Blocking: none? * Blocked: ** Target architecture without gallium (email followup) https://phabricator.wikimedia.org/T133300 * Updates ** Browser Testing survey still open https://goo.gl/xS6mmV (phab task for info: https://phabricator.wikimedia.org/T131123) ** CI reduced yesterday, should be good now ** Scap3 migration - new guide posted on wikitech https://wikitech.wikimedia.org/wiki/Scap3/Migration_Guide === Technical Operations === * '''Blocking''' ** None * '''Blocked''' ** By noone * Updates ** All image scalers are now on jessie with updated librsvg, fixes plenty of bugs (also related to changes to fonts while at it) ** Enabled TCP Fast Open on some caching clusters ** gitblit is finally dead ** Working with LE to get apertium packages reviewed/uploaded on apt.wikimedia.org. Some 20% done