https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
= 2016-05-04 =
== Technology ==
=== Release Engineering ===
For all:
* T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs
** The migration of browsertests* to selenium* is almost complete, however, Željko needs people to claim their failing browser tests. See the task for more information.
*** The task has a table, but it's not clear what you want people to do (are you just asking about the rows with missing "contact from browsertests.yaml" fields)?
For operations:
* T126594 - Disable HHVM fcgi server on CI slaves
* Need help from ops to review and merge these two patches (we dont need HHVM running as a daemon on CI boxes):
** https://gerrit.wikimedia.org/r/#/c/269946/
** https://gerrit.wikimedia.org/r/#/c/269947/
* https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool instances (contintcloud tenant)
** More instances needed. Clarified with Chase last week: pending Andrew. No urgency.
* Two related tasks, each have patches that are needed to streamline the scap3 migration:
** T133211 - Automate the generation deployment keys (keyholder-managed ssh keys)
*** https://gerrit.wikimedia.org/r/#/c/284418/
** T132747 - scap::target shouldn't allow users to redefine the user's key
*** https://gerrit.wikimedia.org/r/#/c/285519/
=== Security ===
* Reviews:
** json-schema done, AuthManger done (no more comments, a few minor things before all patches are +1'ed)
** Starting on T129584 this week
* Starting work on AuthService next week (heads up to Services, we'll probably be scheduling a few meetings with you) (Marko: ack && yay!)
* Ops: ping again on T128819
=== Services ===
(Marko cannot attend today, sorry)
* RESTBase
** working on storing all auth checks locally (now we are calling the MW API every time)
* EventBus / Change propagation
** started using it in production for the summary endpoint today
** more dependency updates to follow soon
* Cassandra move to 2.2.6 soon
** first up: maps cluster
* use Scap3 - https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html
=== Technical Operations
* '''Blocking''':
** none
* '''Blocked''':
** none
* '''Updates''':
** May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully deployed till then
** started using letsencrypt for various small services
== Product ==
=== Reading ===
* Most of Reading engineering is at an offsite today, I believe.
==== Reading Infrastructure ====
* AuthManager core patches are just waiting for security +1s. Work is ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could use reviews if anyone is interested.
=== Editing ===
==== Collaboration ====
* '''Blocking''':
** External store work. External Store deployed everywhere on Beta with no complications. Work on this continues. We now need to set up a second External Store on Beta for Flow, to test the migration.
* '''Blocked''':
** Work on Flow dumps continuing on the ops side. https://phabricator.wikimedia.org/T119511 and https://phabricator.wikimedia.org/T89398 .
* '''Updates''':
** Continuing notification work on:
*** Cross-wiki notifications coming by default on May 12th!
*** Echo email formatter
*** Work continues on the new Echo MVC architecture
==== Parsing ====
* We got our first visual diff test run comparing Tidy with HTML5depurate. Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @ https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this as the basis for figuring out what things might break if we replace Tidy today and what needs fixing and where.
* Scott has been working with Ops to get OCG kinks ironed out.
==== Language ====
* '''Blocking''':
** Apertium->Jessie. Yet to finalize plan and proceed.
* '''Blocked''':
* '''Updates''':
** cxserver service will be migrated to scap3 deployment soon.
** Translate (twn, meta,..) now using Apertium MT from cxserver.
== Discovery ==
* '''Blocking''': none
* '''Blocked''': none
* Preparing for ElasticSearch 2.0 migration
* Results for A/B test on portal language link location published: https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_De...
* TextCat A/B test launching soon
* Portal A/B test adding descriptions to project links to start this week
* WDQS redeployed, some performance issues
* Graphs have ability to use WDQS directly now
* Team offsite in 2 weeks (17-21)
==Analytics ==
*Scaling of pageview API , more work than anticipated
*Working new domain analytics.wikimedia.org, wikistats 2.0 migration, meeting with research to map early states of project
*Still trouble with jenkins
*
== Fundraising Tech ==
* coding new PayPal integration
* pulling in lots of CiviCRM upstream changes
* making CentralNotice fail gracefully in odd cache edge cases
* Casey hanging out with reading offsite
* more work towards replacing ActiveMQ
On Thu, May 5, 2016 at 5:24 PM, Grace Gellerman ggellerman@wikimedia.org wrote:
https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
= 2016-05-04 =
== Technology ==
=== Release Engineering ===
For all:
- T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs
** The migration of browsertests* to selenium* is almost complete, however, Željko needs people to claim their failing browser tests. See the task for more information.
*** The task has a table, but it's not clear what you want people to do (are you just asking about the rows with missing "contact from browsertests.yaml" fields)?
Please see "Ownership of Selenium tests" e-mail sent to this list yesterday for more information.
In short, I need to populate this table:
https://phabricator.wikimedia.org/T134492
Željko
On 5 May 2016 9:24 a.m., "Grace Gellerman" ggellerman@wikimedia.org wrote:
https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
= 2016-05-04 =
== Technology ==
=== Release Engineering ===
For all:
- T128190 - Migration of browsertests* Jenkins jobs to selenium* jobs
Hi Zeljko, Can you clarify what you need help with here? Is it merging patches/updating empty columns on that table/other?
Which tests are failing? Jon
** The migration of browsertests* to selenium* is almost complete,
however,
Željko needs people to claim their failing browser tests. See the task for more information.
*** The task has a table, but it's not clear what you want people to do (are you just asking about the rows with missing "contact from browsertests.yaml" fields)?
For operations:
T126594 - Disable HHVM fcgi server on CI slaves
Need help from ops to review and merge these two patches (we dont need
HHVM running as a daemon on CI boxes):
** https://gerrit.wikimedia.org/r/#/c/269946/
** https://gerrit.wikimedia.org/r/#/c/269947/
- https://phabricator.wikimedia.org/T133911 - Bump quota of Nodepool
instances (contintcloud tenant)
** More instances needed. Clarified with Chase last week: pending Andrew. No urgency.
- Two related tasks, each have patches that are needed to streamline the
scap3 migration:
** T133211 - Automate the generation deployment keys (keyholder-managed
ssh
keys)
*** https://gerrit.wikimedia.org/r/#/c/284418/
** T132747 - scap::target shouldn't allow users to redefine the user's key
*** https://gerrit.wikimedia.org/r/#/c/285519/
=== Security ===
- Reviews:
** json-schema done, AuthManger done (no more comments, a few minor things before all patches are +1'ed)
** Starting on T129584 this week
- Starting work on AuthService next week (heads up to Services, we'll
probably be scheduling a few meetings with you) (Marko: ack && yay!)
- Ops: ping again on T128819
=== Services ===
(Marko cannot attend today, sorry)
- RESTBase
** working on storing all auth checks locally (now we are calling the MW API every time)
- EventBus / Change propagation
** started using it in production for the summary endpoint today
** more dependency updates to follow soon
- Cassandra move to 2.2.6 soon
** first up: maps cluster
- use Scap3 -
https://lists.wikimedia.org/pipermail/wikitech-l/2016-April/085299.html
=== Technical Operations
- '''Blocking''':
** none
- '''Blocked''':
** none
- '''Updates''':
** May 15 (Chrome SPDY removal deadline). Getting HTTP/2 working fully deployed till then
** started using letsencrypt for various small services
== Product ==
=== Reading ===
- Most of Reading engineering is at an offsite today, I believe.
==== Reading Infrastructure ====
- AuthManager core patches are just waiting for security +1s. Work is
ongoing on extensions; CentralAuth, LdapAuthentication, ConfirmEdit could use reviews if anyone is interested.
=== Editing ===
==== Collaboration ====
- '''Blocking''':
** External store work. External Store deployed everywhere on Beta with
no
complications. Work on this continues. We now need to set up a second External Store on Beta for Flow, to test the migration.
- '''Blocked''':
** Work on Flow dumps continuing on the ops side. https://phabricator.wikimedia.org/T119511 and https://phabricator.wikimedia.org/T89398 .
- '''Updates''':
** Continuing notification work on:
*** Cross-wiki notifications coming by default on May 12th!
*** Echo email formatter
*** Work continues on the new Echo MVC architecture
==== Parsing ====
- We got our first visual diff test run comparing Tidy with HTML5depurate.
Results @ http://mw-expt-tests.wmflabs.org/ ... Making notes @ https://www.mediawiki.org/wiki/Parsing/Replacing_Tidy ... We will use this as the basis for figuring out what things might break if we replace Tidy today and what needs fixing and where.
- Scott has been working with Ops to get OCG kinks ironed out.
==== Language ====
- '''Blocking''':
** Apertium->Jessie. Yet to finalize plan and proceed.
'''Blocked''':
'''Updates''':
** cxserver service will be migrated to scap3 deployment soon.
** Translate (twn, meta,..) now using Apertium MT from cxserver.
== Discovery ==
'''Blocking''': none
'''Blocked''': none
Preparing for ElasticSearch 2.0 migration
Results for A/B test on portal language link location published:
https://commons.wikimedia.org/wiki/File:Wikipedia_Portal_Test_of_Language_De...
TextCat A/B test launching soon
Portal A/B test adding descriptions to project links to start this week
WDQS redeployed, some performance issues
Graphs have ability to use WDQS directly now
Team offsite in 2 weeks (17-21)
==Analytics ==
*Scaling of pageview API , more work than anticipated
*Working new domain analytics.wikimedia.org, wikistats 2.0 migration, meeting with research to map early states of project
*Still trouble with jenkins
== Fundraising Tech ==
coding new PayPal integration
pulling in lots of CiviCRM upstream changes
making CentralNotice fail gracefully in odd cache edge cases
Casey hanging out with reading offsite
more work towards replacing ActiveMQ
Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Thu, May 5, 2016 at 5:52 PM, Jon Robson jrobson@wikimedia.org wrote:
Can you clarify what you need help with here? Is it merging patches/updating empty columns on that table/other?
Which tests are failing?
Tests fail all the time. See this task for some history:
https://phabricator.wikimedia.org/T94150
Sometimes a job is broken for more than a month. I would like to avoid that. I need one or more people to be owners of Selenium tests for each repository, so when something is broken, they fix it.
Did I answer your question?
Željko
Yes. Thanks. I think I've done my bit. Let me know if there is anything else you need from me.
On Thu, May 5, 2016 at 9:58 AM, Željko Filipin zfilipin@wikimedia.org wrote:
On Thu, May 5, 2016 at 5:52 PM, Jon Robson jrobson@wikimedia.org wrote:
Can you clarify what you need help with here? Is it merging patches/updating empty columns on that table/other?
Which tests are failing?
Tests fail all the time. See this task for some history:
https://phabricator.wikimedia.org/T94150
Sometimes a job is broken for more than a month. I would like to avoid that. I need one or more people to be owners of Selenium tests for each repository, so when something is broken, they fix it.
Did I answer your question?
Željko _______________________________________________ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
On Thu, May 5, 2016 at 6:27 PM, Jon Robson jdlrobson@gmail.com wrote:
Yes. Thanks. I think I've done my bit. Let me know if there is anything else you need from me.
Thanks Jon. I will add you to a few gerrit patches.
Željko
On 05/05/2016 08:24 AM, Grace Gellerman wrote:
https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-05-04
= 2016-05-04 =
==Analytics == *Still trouble with jenkins
Are there any more details about this or a bug filed for it?
-- Legoktm
wikitech-l@lists.wikimedia.org