Wikitech-l March 2016

wikitech-l@lists.wikimedia.org

109 participants
98 discussions

IEG proposal: Improve Upload to Commons Android app
by Josephine Lim 04 Mar '16

04 Mar '16

Hi folks, I've been working on the Upload to Commons Android app[1] for the past few months as an Outreachy project (which was recently completed successfully[2] :)). A few changes were made to the app to make categorization of pictures easier, via suggestion of nearby categories and more flexible category search. However, there are lots of improvements (documented on our GitHub page[3]) that we couldn't fit into the scope of the Outreachy project. I would love to be able to continue working on the app to improve it further - hence an IEG proposal. My IEG proposal for the app involves: - Fixing long-standing bugs and looking into old crash reports to try and prevent them from recurring, to provide a smoother user experience - Making several enhancements to the app to make it more user-friendly and newbie-friendly, new location-based features (e.g. a list of nearby articles lacking pictures), and further enhancing categorization. - Increasing awareness of non-Wikimedians about this app to grow the contributor base Several of the proposed features are based on previous suggestions by users, and I would very much appreciate more feedback and suggestions! If you are interested, please do take a look at the current proposal[4], feel free to ask questions and make new suggestions on the Discussion page, and review it as you see fit. If you would like to be part of the project, volunteers and additional advisors are always welcome. Thank you so much! [1] https://play.google.com/store/apps/details?id=fr.free.nrw.commons [2] https://phabricator.wikimedia.org/T126848 [3] https://github.com/nicolas-raoul/apps-android-commons/issues [4] https://meta.wikimedia.org/wiki/Grants:IEG/Improve_%27Upload_to_Commons%27_… -- Regards, Josephine

2 2

Wikimedia accepted for GSoC '16
by Sumit Asthana 03 Mar '16

03 Mar '16

Greetings, Congratulations to all. Yet again, Wikimedia has been accepted as a mentoring organization for the Google Summer of Code program. The two programs GSoC '16 and Outreachy 12 are now in full swing and we require your support to make them successful! The timeline for GSoC '16 is [1]. We have a lot of project ideas in the Possible-Tech-Projects board[2], where students can look for projects. Some of them are already featured, while a lot more *require your love*. Feel free to add yourself as a mentor if you think you could help move any of the projects forward, especially in the "*Discussion*" and "*Missing mentors*" column. A lot of projects in the "*Missing mentors*" column have also been recently added, which are Community wishlist items, and stand a good chance of being featured. Enlisting some of the more discussed projects here - 1. Technology to transclude git content into Wiki pages - [3] 2. Improving static analysis tool for MediaWiki.[4] 3. Make the education program dashboard usable for all languages and projects.[5] Comments are *most welcome* in shaping these ideas into featured projects. Also, if you know of other projects/ideas which could be a good fit for a 3 month GSoC/Outreachy internship, just add #possible-tech-projects to them and we'll help in defining its scope. More info can be found out at the MediaWiki page for GSoC '16[6] Lets collaborate and help students turn some *ideas into reality*! [1] - https://developers.google.com/open-source/gsoc/timeline [2] - https://phabricator.wikimedia.org/tag/possible-tech-projects/ [3] - https://phabricator.wikimedia.org/T91626 [4] - https://phabricator.wikimedia.org/T89682 [5] - https://phabricator.wikimedia.org/T91676 [6] - https://www.mediawiki.org/wiki/Google_Summer_of_Code_2016 -Thank You! -Sumit -Co-organizer of GSoC '16 and Outreachy 12 alongwith Tony Thomas

2 1

Developer Relations Weekly Summary
by Quim Gil 03 Mar '16

03 Mar '16

The new Developer Relations Weekly Summary can be found at https://www.mediawiki.org/wiki/Developer_Relations/Weekly_summary#2016-03-03 We have been focusing on * Wikimedia Hackathon 2016 travel and accommodation. * WikiArabia - technical sessions and Wikimedia Technical Workshop in Ramallah * Improvements in tech community metrics * Technical Collaboration's team strategy and Annual Plan -- Quim Gil Engineering Community Manager @ Wikimedia Foundation http://www.mediawiki.org/wiki/User:Qgil

1 0

Node.js services on SCB switched to Node 4.3
by Marko Obrovac 03 Mar '16

03 Mar '16

Hello, We have updated the nodejs package version from 4.2.4 to 4.3.0 on the SCB service cluster running in production. The services running there have been restarted and tested. I have also taken the liberty to update the build portion of the package.json's in the source repositories so that the respective build systems create node dependencies compiled with the correct version of the node binary. The affected services and their respective patch-sets are: - citoid: https://gerrit.wikimedia.org/r/#/c/274688/ - cxserver: https://gerrit.wikimedia.org/r/#/c/274685/ - graphoid: https://gerrit.wikimedia.org/r/#/c/274687/ - mathoid: https://gerrit.wikimedia.org/r/#/c/274684/ - mobileapps: https://gerrit.wikimedia.org/r/#/c/274689/ Note that because of these changes, the next time you build the deploy repository it will take a while longer since the new version of Node.js needs to be downloaded and configured in the service's container image. The good news is that you don't have to do anything but wait a bit :) Thanks to Moritz Mühlenhoff from Ops for making this happen! Cheers, Marko -- Marko Obrovac, PhD Senior Services Engineer Wikimedia Foundation

1 0

limited presence
by Derk-Jan Hartman 03 Mar '16

03 Mar '16

Hi all, ive had a small accident with skiing. ill be fine, but because of it my participation will be low for some while and though i am reading along with some things, any answers will like be terse, and code will be none. DJ

5 4

Re: [Wikitech-l] [Engineering] Looking for more additions to SWAT (deploy) team
by Greg Grossmeier 02 Mar '16

02 Mar '16

<quote name="Madhumitha Viswanathan" date="2016-03-02" time="14:34:25 -0800"> > I'd love to help if you're looking for more people! Yay! (follow-up offlist...) -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |

1 0

Re: [Wikitech-l] [Engineering] Looking for more additions to SWAT (deploy) team
by Greg Grossmeier 02 Mar '16

02 Mar '16

<quote name="Max Semenik" date="2016-03-02" time="14:25:07 -0800"> > I could do it. CI that was making me sad previously is in a much better > shape now (thanks!) so I'm in. Sweet! Thanks Max! (moving logistics offthread...) -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |

1 0

Scrum of Scrums - 2016-03-02
by Greg Grossmeier 02 Mar '16

02 Mar '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-03-02 = 2016-03-02 = == Technology == === Analytics === * '''Blocking''': ** Anyone working on Hadoop, due to encoding issue, reported on the list, leaves cluster unavailable probably until Monday March 7th. * '''Blocked''': ** (nobody we know) * '''Updates''': ** Some of our JVMs started with a non-UTF8 encoding causing page title extraction to create weird characters. We're fixing by backfilling data back to February 22nd. Due to this backfilling, the cluster will be busy and so we asked people to not use it until it's caught back up. Going forward we found an environment variable that will enforce the proper file.encoding. ** The Analytics Query Service (which hosts the pageview API) is fully split up from RESTBase, so we'll be able to add features and new endpoints more easily. ** Shifting to declaratively specifying which requests are pageviews, by setting a value in the X-Analytics header. If you're writing clients that generate what should be considered a "pageview", come talk to us. === Release Engineering === * '''Blocking''': ** Upcoming security patches to be deployed * '''Blocked''': ** Ops help: https://gerrit.wikimedia.org/r/#/c/272947/ * '''Updates''': ** Rolling out wmf.15 this week ** March 21st week of: no deploy week! === Research === * '''Blocking''': ** nothing that we know of * '''Blocked''': ** none reported * '''Updates''': ** Running a quicksurvey at a rate of 1:50 to learn about our readers. The survey will stop on 2016-03-07. It's tracked in https://phabricator.wikimedia.org/T125946 and all research documentations are in https://meta.wikimedia.org/wiki/Research:Characterizing_Wikipedia_Reader_Be… === Security === * '''Blocking''': ** none? * '''Blocked''': ** ??? * '''Updates''': ** Finishing review of horizon 2fa ** Lots of security patches to deploy ** sysop password policy, hash upgrades next week === Services === * '''Blocking''': ** possibly none * '''Blocked''': ** Ops: Change propagation deployment - https://phabricator.wikimedia.org/T128463 ** Ops: Varnish caching - https://phabricator.wikimedia.org/T127387 * '''Updates''': ** Caching enabled for most endpoints, watch out for titles with special characters ** API build-out: RB realted-pages endpoint - https://phabricator.wikimedia.org/T125983 ** EventBus: resource_change event - https://phabricator.wikimedia.org/T126687 ** RB cluster expansion continuing ** Cassandra - switching to 2.1.13, soon to 2.2.5 ** rate limiting soon coming to service-runner === Technical Operations === * '''Blocking''': ** research on ORES deployment in production * '''Blocked''': ** By none * '''Updates''': ** Be aware of https://phabricator.wikimedia.org/T124356 == Product == === Discovery === * '''Blocking''': ** none * '''Blocked''': ** Security Review of SVG sanitization node lib ** Security Review of PHP Schema validator lib ** Ops: Need to figure out the plan for maps hardware * '''Updates''': ** Portal stats updated ** Portal UI improvements in code review, will be released soon ** Upgrading ES to 1.7.5 ** Working on ES tuning & logging improvements ** WDQS upgraded to BG 2.0 successfully ** Releasing Kartographer next week to Wikivoyage === Reading === ==== Web ==== * PageImages to strip non-free images given results of analysis and conclusion that impact will be low https://phabricator.wikimedia.org/T125977#2056988 * Preparing to enable stored references on Japanese Wikipedia Dependencies: Ops, Jamie Crespo. Expect it to increase db storage but hopefully no performance impacts. https://phabricator.wikimedia.org/T126802 * Working on lazy loading references and images ==== Android ==== * '''Updates''': ** Working towards a new beta with support for user options. ==== iOS ==== ==== Mobile Content Service ==== * '''Updates''': Enabling to run the service on beta cluster (http vs https) https://phabricator.wikimedia.org/T113542 * '''Blocking''': Varnish not purging RESTBase URIs https://phabricator.wikimedia.org/T127370 ==== Reading Infrastructure ==== * SessionManager seems to be pretty solidly out there. We've been working with Performance to add in-process caching in some critical places, and preparing to set MW_NO_SESSIONS for the load.php entry point as mentioned last week. * AuthManager is coming! ** No longer blocking: Mobile apps: You should be able to start testing the API changes on https://authmanager.wmflabs.org/wiki/api.php now, the API classes should hopefully be stable at this point. ** We plan to have the core patches feature complete by March 15. *** The plan is to include a temporary feature flag, and to merge it to master with the flag disabled ASAP to make testing and updating extensions easier. *** Blocked: SECURITY: We could use security review on the AuthManager core bits as soon as possible. **** Main: https://gerrit.wikimedia.org/r/#/c/195297/ (I think you've mostly already reviewed this one, should be ready except for emailing of temporary passwords) **** API: https://gerrit.wikimedia.org/r/#/c/265201/ (Should be ready for review now, except for the new module for emailing of temporary passwords) **** UI: https://gerrit.wikimedia.org/r/#/c/240052/ (Still in progress) *** Help requested: SECURITY: Double-checking that any auth-related security changes in core aren't going to be lost would also be very helpful. ** Then we will start looking at WMF-deployed extensions that need updating (and send another email to wikitech-l). *** The current list of extensions that seem to need some sort of attention is the blockers of https://phabricator.wikimedia.org/T110282; look for access to $wgAuth, AuthPlugin, or a list of hooks that will eventually be posted on that bug. Most of these we'll probably fix ourselves, but help will be appreciated if anyone is interested. **** Stuff for https://phabricator.wikimedia.org/T68699 was already removed as part of SessionManager patch. Would be good to solve that problem somehow. ***** No it wasn't. See discussion on the bug. *** Help to be requested: Mobile: We'd really appreciate your help making sure that MobileFrontend functions if the AuthManager feature flag is enabled. We think the impact will mostly be in whatever you're injecting into the login and account creation pages. *** Help to be requested: Language: The Translate extension's TranslateSandbox class is creating and even trying to delete local users, which is scary and will likely need work. **** NL: That's by design ;) Not used in WMF but in translatewiki.net. Ping me on IRC or so. *** Help to be requested: Ops/Labs?: Bryan Davis is going to talk to Andrew Bogott and Alex Monk about collaborating on testing the changes we'll have to make to LdapAuthentication and OpenStackManager on the existing infrastructure you're using for testing your OpenStackManager changes. *** FYI: Security: At least CentralAuth, LdapAuthentication, and OATHAuth will likely want security reviews as those patches are written. ** Once all the extensions are fixed and tested, then we'll talk about scheduling the feature flag being turned on. === Editing === * Wikidata would appreciate thoughts on the Multi-Content Revisions RfC at https://phabricator.wikimedia.org/T107595 so that we don't break everyone's expectations of MediaWiki :-) ==== Collaboration ==== * '''Blocking''': ** External Store - Prep work for External Store on Beta is in progress. * '''Blocked''': ** No new blockers * '''Updates''': ** Following up on cross-wiki notifications, e.g. changing how human-readable names work. ** Most Flow board move issues are fixed, working on one remaining thing. ** Temporarily disabled thank you notification due to bug ==== Language ==== * '''Blocking''': Nothing * '''Blocked''': Nope * '''Updates''': ** Next week will be slow week ==== Multimedia ==== * '''Blocking''': N/A * '''Blocked''': N/A * '''Updates''': ** Potential issues with licensing in ImageTweaks, working on it ** Wikibase for Commons repository was requested, which is exciting ** Performance improvements to UploadWizard rolling out ==== Parsing ==== * '''Blocking''': Not that I know of – From Labs: https://phabricator.wikimedia.org/T128620 * '''Blocked''': None * '''Updates''': ** Templatedata-based serialization deployed last Wednesday *** Follow ups and bug fixes in progress ** Attribute parsing in tags now uses HTML5 parsing semantics ( https://phabricator.wikimedia.org/T108134 ) -- frwikisource needed a lot of fixes for <pages from= to= .. > style tags that editors fixed with a bot. *** Parsoid-side fix went out on Monday *** core-side fix will go out with wmf15 train ** Some progress on https://phabricator.wikimedia.org/T124356 -- Kunal's logging seems to have yielded results and he pushed a fix to the MobileFrontend extension. ** Work ongoing to set up prod wiki clones on labs vms -- more involved than it should be. Required for visual diff testing to test tweaks / changes to wikitext parsing / tidy replacement / etc. ==== VisualEditor ==== * '''Blocking''': ** None known. * '''Blocked''': ** Waiting on Design Research availability for user testing of Single Edit Tab integration * '''Updates''': ** Single Edit Tab live on group0 and Hungarian Wikipedia; next up, Polish Wikipedia, then English. ** OOUI on all pages: Initial proof-of-concept code https://gerrit.wikimedia.org/r/274328 being written. Deployment will not be next week, and will be in concert with Discovery and Performance teams. === Fundraising Tech === * No blockers * preparing real donor test of backup worldwide credit card processor * Working out final details of Latin American payment processing expansion * Steady stream of CiviCRM enhancements for us and upstream * More experiments in fraud monitoring and blocking * Adam Wight and Andrew Green return from a month of work on education program tools -- | Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E | | identi.ca: @greg A18D 1138 8E47 FAC8 1C7D |

1 0

Fwd: [Ops] Minor Phab instability
by Legoktm 02 Mar '16

02 Mar '16

-------- Forwarded Message -------- Subject: [Ops] Minor Phab instability Date: Wed, 2 Mar 2016 19:55:13 +0000 From: Chad Horohoe <chorohoe(a)wikimedia.org> To: Operations Engineers <ops(a)lists.wikimedia.org>, Development and Operations engineers (WMF only) <engineering(a)lists.wikimedia.org> Hi all, As you may have noticed lately, there's been a bit of a problem with Phabricator--mostly of the sort where it complains about not being able to connect to the m3 database. This is known, and is unfortunately a one time migration cost associated with getting the remaining Gerrit repositories indexed in Phabricator. The work should be done by the end of the week, and I'm trying to batch it as small as possible to try and limit disruption. Thanks for bearing with me! -Chad

1 0

dataset1001 (dumps.wikimedia.org) maintenance window March 2 1-4pm UTC
by Ariel Glenn WMF 02 Mar '16

02 Mar '16

Dataset1001, the host which serves dumps and other datasets to the public, as well as providing access to various datasets directly on stats100x, will be unavailable tomorrow for an upgrade to jessie. While I don't expect to need nearly 3 hours for the upgrade, better safe than sorry. In the meantime all files will be accessible via ms1001.wikimedia.org via the web, and all dumps and page view files from our mirrors as well. Thanks for your understanding. Ariel Glenn

1 2

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l March 2016