https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-03-02
= 2016-03-02 =
== Technology ==
=== Analytics ===
* '''Blocking''':
** Anyone working on Hadoop, due to encoding issue, reported on the list, leaves cluster
unavailable probably until Monday March 7th.
* '''Blocked''':
** (nobody we know)
* '''Updates''':
** Some of our JVMs started with a non-UTF8 encoding causing page title extraction to
create weird characters. We're fixing by backfilling data back to February 22nd. Due
to this backfilling, the cluster will be busy and so we asked people to not use it until
it's caught back up. Going forward we found an environment variable that will enforce
the proper file.encoding.
** The Analytics Query Service (which hosts the pageview API) is fully split up from
RESTBase, so we'll be able to add features and new endpoints more easily.
** Shifting to declaratively specifying which requests are pageviews, by setting a value
in the X-Analytics header. If you're writing clients that generate what should be
considered a "pageview", come talk to us.
=== Release Engineering ===
* '''Blocking''':
** Upcoming security patches to be deployed
* '''Blocked''':
** Ops help:
https://gerrit.wikimedia.org/r/#/c/272947/
* '''Updates''':
** Rolling out wmf.15 this week
** March 21st week of: no deploy week!
=== Research ===
* '''Blocking''':
** nothing that we know of
* '''Blocked''':
** none reported
* '''Updates''':
** Running a quicksurvey at a rate of 1:50 to learn about our readers. The survey will
stop on 2016-03-07. It's tracked in
https://phabricator.wikimedia.org/T125946 and all
research documentations are in
https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Be…
=== Security ===
* '''Blocking''':
** none?
* '''Blocked''':
** ???
* '''Updates''':
** Finishing review of horizon 2fa
** Lots of security patches to deploy
** sysop password policy, hash upgrades next week
=== Services ===
* '''Blocking''':
** possibly none
* '''Blocked''':
** Ops: Change propagation deployment -
https://phabricator.wikimedia.org/T128463
** Ops: Varnish caching -
https://phabricator.wikimedia.org/T127387
* '''Updates''':
** Caching enabled for most endpoints, watch out for titles with special characters
** API build-out: RB realted-pages endpoint -
https://phabricator.wikimedia.org/T125983
** EventBus: resource_change event -
https://phabricator.wikimedia.org/T126687
** RB cluster expansion continuing
** Cassandra - switching to 2.1.13, soon to 2.2.5
** rate limiting soon coming to service-runner
=== Technical Operations ===
* '''Blocking''':
** research on ORES deployment in production
* '''Blocked''':
** By none
* '''Updates''':
** Be aware of
https://phabricator.wikimedia.org/T124356
== Product ==
=== Discovery ===
* '''Blocking''':
** none
* '''Blocked''':
** Security Review of SVG sanitization node lib
** Security Review of PHP Schema validator lib
** Ops: Need to figure out the plan for maps hardware
* '''Updates''':
** Portal stats updated
** Portal UI improvements in code review, will be released soon
** Upgrading ES to 1.7.5
** Working on ES tuning & logging improvements
** WDQS upgraded to BG 2.0 successfully
** Releasing Kartographer next week to Wikivoyage
=== Reading ===
==== Web ====
* PageImages to strip non-free images given results of analysis and conclusion that impact
will be low
https://phabricator.wikimedia.org/T125977#2056988
* Preparing to enable stored references on Japanese Wikipedia Dependencies: Ops, Jamie
Crespo. Expect it to increase db storage but hopefully no performance impacts.
https://phabricator.wikimedia.org/T126802
* Working on lazy loading references and images
==== Android ====
* '''Updates''':
** Working towards a new beta with support for user options.
==== iOS ====
==== Mobile Content Service ====
* '''Updates''': Enabling to run the service on beta cluster (http
vs https)
https://phabricator.wikimedia.org/T113542
* '''Blocking''': Varnish not purging RESTBase URIs
https://phabricator.wikimedia.org/T127370
==== Reading Infrastructure ====
* SessionManager seems to be pretty solidly out there. We've been working with
Performance to add in-process caching in some critical places, and preparing to set
MW_NO_SESSIONS for the load.php entry point as mentioned last week.
* AuthManager is coming!
** No longer blocking: Mobile apps: You should be able to start testing the API changes on
https://authmanager.wmflabs.org/wiki/api.php now, the API classes should hopefully be
stable at this point.
** We plan to have the core patches feature complete by March 15.
*** The plan is to include a temporary feature flag, and to merge it to master with the
flag disabled ASAP to make testing and updating extensions easier.
*** Blocked: SECURITY: We could use security review on the AuthManager core bits as soon
as possible.
**** Main:
https://gerrit.wikimedia.org/r/#/c/195297/ (I think you've mostly already
reviewed this one, should be ready except for emailing of temporary passwords)
**** API:
https://gerrit.wikimedia.org/r/#/c/265201/ (Should be ready for review now,
except for the new module for emailing of temporary passwords)
**** UI:
https://gerrit.wikimedia.org/r/#/c/240052/ (Still in progress)
*** Help requested: SECURITY: Double-checking that any auth-related security changes in
core aren't going to be lost would also be very helpful.
** Then we will start looking at WMF-deployed extensions that need updating (and send
another email to wikitech-l).
*** The current list of extensions that seem to need some sort of attention is the
blockers of
https://phabricator.wikimedia.org/T110282; look for access to $wgAuth,
AuthPlugin, or a list of hooks that will eventually be posted on that bug. Most of these
we'll probably fix ourselves, but help will be appreciated if anyone is interested.
**** Stuff for
https://phabricator.wikimedia.org/T68699 was already removed as part of
SessionManager patch. Would be good to solve that problem somehow.
***** No it wasn't. See discussion on the bug.
*** Help to be requested: Mobile: We'd really appreciate your help making sure that
MobileFrontend functions if the AuthManager feature flag is enabled. We think the impact
will mostly be in whatever you're injecting into the login and account creation
pages.
*** Help to be requested: Language: The Translate extension's TranslateSandbox class
is creating and even trying to delete local users, which is scary and will likely need
work.
**** NL: That's by design ;) Not used in WMF but in
translatewiki.net. Ping me on IRC
or so.
*** Help to be requested: Ops/Labs?: Bryan Davis is going to talk to Andrew Bogott and
Alex Monk about collaborating on testing the changes we'll have to make to
LdapAuthentication and OpenStackManager on the existing infrastructure you're using
for testing your OpenStackManager changes.
*** FYI: Security: At least CentralAuth, LdapAuthentication, and OATHAuth will likely want
security reviews as those patches are written.
** Once all the extensions are fixed and tested, then we'll talk about scheduling the
feature flag being turned on.
=== Editing ===
* Wikidata would appreciate thoughts on the Multi-Content Revisions RfC at
https://phabricator.wikimedia.org/T107595 so that we don't break everyone's
expectations of MediaWiki :-)
==== Collaboration ====
* '''Blocking''':
** External Store - Prep work for External Store on Beta is in progress.
* '''Blocked''':
** No new blockers
* '''Updates''':
** Following up on cross-wiki notifications, e.g. changing how human-readable names work.
** Most Flow board move issues are fixed, working on one remaining thing.
** Temporarily disabled thank you notification due to bug
==== Language ====
* '''Blocking''': Nothing
* '''Blocked''': Nope
* '''Updates''':
** Next week will be slow week
==== Multimedia ====
* '''Blocking''': N/A
* '''Blocked''': N/A
* '''Updates''':
** Potential issues with licensing in ImageTweaks, working on it
** Wikibase for Commons repository was requested, which is exciting
** Performance improvements to UploadWizard rolling out
==== Parsing ====
* '''Blocking''': Not that I know of – From Labs:
https://phabricator.wikimedia.org/T128620
* '''Blocked''': None
* '''Updates''':
** Templatedata-based serialization deployed last Wednesday
*** Follow ups and bug fixes in progress
** Attribute parsing in tags now uses HTML5 parsing semantics (
https://phabricator.wikimedia.org/T108134 ) -- frwikisource needed a lot of fixes for
<pages from= to= .. > style tags that editors fixed with a bot.
*** Parsoid-side fix went out on Monday
*** core-side fix will go out with wmf15 train
** Some progress on
https://phabricator.wikimedia.org/T124356 -- Kunal's logging seems
to have yielded results and he pushed a fix to the MobileFrontend extension.
** Work ongoing to set up prod wiki clones on labs vms -- more involved than it should be.
Required for visual diff testing to test tweaks / changes to wikitext parsing / tidy
replacement / etc.
==== VisualEditor ====
* '''Blocking''':
** None known.
* '''Blocked''':
** Waiting on Design Research availability for user testing of Single Edit Tab
integration
* '''Updates''':
** Single Edit Tab live on group0 and Hungarian Wikipedia; next up, Polish Wikipedia, then
English.
** OOUI on all pages: Initial proof-of-concept code
https://gerrit.wikimedia.org/r/274328
being written. Deployment will not be next week, and will be in concert with Discovery and
Performance teams.
=== Fundraising Tech ===
* No blockers
* preparing real donor test of backup worldwide credit card processor
* Working out final details of Latin American payment processing expansion
* Steady stream of CiviCRM enhancements for us and upstream
* More experiments in fraud monitoring and blocking
* Adam Wight and Andrew Green return from a month of work on education program tools
--
| Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E |
| identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |