Wikitech-l June 2016

wikitech-l@lists.wikimedia.org

78 participants
85 discussions

2016-06-22 Scrum of Scrums meeting notes
by Grace Gellerman 22 Jun '16

22 Jun '16

https://www.mediawiki.org/wiki/Scrum_of_scrums/2016-06-22 = 2016-06-22 = == Product == === Reading === ==== iOS ==== * 5.0.5 ** Through regressions - a bug was found and fixed - regressions start again today ** Expected release this week * 5.1 ** In development - expected release early August ** Potential blocker for release is GeoData API improvements https://phabricator.wikimedia.org/T137178 We are working with Discovery to get this in for our release ==== Android ==== Still working on the feed, no blockers/blockees. ==== Mobile Content Service (MCS) ==== * Adding content format versioning to Content-Type header for better pre-generation and backwards compatibility. https://phabricator.wikimedia.org/T138018 ==== Reading Web ==== * Going to be deploying lazy images to more small/medium wikis during this last sprint ==== Reading Infrastructure ==== === Editing === ==== Multimedia ==== * Mark not present today, but wanted to add mostly empty update * Not blocking, not blocked * No real updates, work continues as ever ==== Language ==== * Compact Language Links deployment started in phases === Discovery === * '''Blocking''': none * '''Blocked''': https://phabricator.wikimedia.org/T128546 and https://phabricator.wikimedia.org/T135029 need help with scripts * Portal discussion: Should HTML formatting/DOM manip (presentation, responsiveness) be done in JS (frontend) or in PHP (backend) ( https://phabricator.wikimedia.org/T136458) * TextCat A/B test running on enwiki, frwiki, eswiki, dewiki and itwiki * Discernatorn updated: https://discernatron.wmflabs.org === Interactive === * Launched on Wikidata, Commons - no more referrer check, we are open to experementations * RU-Wikivoyage switched * Implementing "get geo object" service * In process of setting up 4 more backend servers (current production 4 backend + 16 caching) == Technology == === RelEng === * No longer blocked: ** gitblit is going away (finally) on the 29th. *** Already announced, patches reviewed and coordinated with tech ops. ** arcanist packaged for debian! Thanks to fgiunchedi for packaging help. *** https://phabricator.wikimedia.org/T137770 * Blocked on tech ops ** Phase out gallium.wikimedia.org (T133300) *** We need feedback from ops about the architecture changes proposed on phabricator *** Tyler summarized in the most recent comment: https://phabricator.wikimedia.org/T133300#2394279 === Technical Operations === * '''Blocking''': ** None * '''Blocked''': ** None * Updates: ** nodejs security release this thursday ** labs team @wikimania, skeleton crew ** appservers and api reimaging, live in eqiad, no outstanding issue ** jessie jobrunner and imagescalers live ** Decomming some 50 db hosts

1 0

Re: [Wikitech-l] Update: Upload to Commons Android app
by Dmitry Brant 21 Jun '16

21 Jun '16

Hi Paul, To be clear, the Commons app is still very much in the hands of volunteers. The WMF has simply allowed the app to use the Commons logo, which will make the app more recognizable and discoverable by users. In fact, this app *used* to be an official WMF project before we discontinued it nearly two years ago, and was subsequently picked up by these excellent volunteers. On Tue, Jun 21, 2016 at 1:04 AM, Paul Laan <paulvlaan(a)gmail.com> wrote: > Hi, > > I think this is good news, but it also makes me wonder the following: > > We saw it happen a couple of times the last months, now the app is in > official WMF hands how long will it take before they kick the volunteers > out, and let the WMF devs work on it? > > I would rather have seen this volunteer (and other) volunteer projects in > the hands of volunteers. Every year the WMF asks for more money, and take > away more and more things the volunteers used to run for free. > > I would rather see things moved to volunteers instead of the other way > arround. > > Paul Vlaan > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l -- Dmitry Brant Senior Software Engineer / Product Owner (Android) Wikimedia Foundation https://www.mediawiki.org/wiki/Wikimedia_mobile_engineering

2 1

Update: Upload to Commons Android app
by Paul Laan 21 Jun '16

21 Jun '16

Hi, I think this is good news, but it also makes me wonder the following: We saw it happen a couple of times the last months, now the app is in official WMF hands how long will it take before they kick the volunteers out, and let the WMF devs work on it? I would rather have seen this volunteer (and other) volunteer projects in the hands of volunteers. Every year the WMF asks for more money, and take away more and more things the volunteers used to run for free. I would rather see things moved to volunteers instead of the other way arround. Paul Vlaan

2 1

[Invitation]: OpenStreetMap Hack Weekend
by Jinal Foflia 21 Jun '16

21 Jun '16

Hey everyone, I wanted to invite all of you to the OpenStreetMap hackweekend on July 2 and 3 in Bangalore being hosted at the Mapbox office. We will spend two full days working on projects like iD, openstreetmap-website, JOSM etc. You can see all the projects and ideas in the wiki http://wiki.openstreetmap.org/wiki/Bengaluru_Hack_weekend_July_2016. Pick one or propose your own. If you are in town and want to contribute to OpenStreetMap, this is a great opportunity to get started alongside expert developers on the open mapping stack! Wikimedia projects have already started integrating maps from OSM https://www.mediawiki.org/wiki/Maps and this can be a useful space to begin work on ideas for greater collaboration between the communities. Please RSVP (https://osmhackweekend.splashthat.com/) and let me know if you have any questions. Read more: https://www.mapbox.com/blog/osm-hackweekend/ Looking forward! Cheers, Jinal Foflia

1 0

The revision scoring weekly update
by Aaron Halfaker 20 Jun '16

20 Jun '16

Hey folks, This is the 9th weekly update for the revision scoring team that we have sent to this mailing list. The biggest news is that we've officially deployed the ORES review tool[1] to Persian Wikipedia and Wikidata[2,9]. We'll be posting a more complete announcement to Wikitech-l soon. New developments: - We generalized how the wsgi and celery applications are configured[4] - We fixed the way Special:Contributions is rendered so that the ORES review tool can work better there[6] Maintenance and robustness: - We documented some downtime for the ORES production service[3] - We untangled and simplified our deployment repositories[5] - An issue with Wikilabels accepting too many labels for a single task is fixed[7] - We brought our deployment of ORES in the beta cluster closer to production[8] - We solved an issue with how the ORES extension populates scores[10] Amir will be hosting a workshop for extending ORES support at Wikimania. See https://phabricator.wikimedia.org/T134628 for more details. 1. https://www.mediawiki.org/wiki/ORES_review_tool 2. https://phabricator.wikimedia.org/T130210 3. https://phabricator.wikimedia.org/T138248 4. https://phabricator.wikimedia.org/T137820 5. https://phabricator.wikimedia.org/T137819 6. https://phabricator.wikimedia.org/T122537 7. https://phabricator.wikimedia.org/T131997 8. https://phabricator.wikimedia.org/T137821 9. https://phabricator.wikimedia.org/T130212 10. https://phabricator.wikimedia.org/T137854 -Aaron

1 0

DNS, TLS change for RCStream (stream.wikimedia.org)
by Ori Livneh 20 Jun '16

20 Jun '16

== What is happening? == Secure connections to RCStream[1] currently use an SSL/TLS certificate[2] specific to stream.wikimedia.org. To streamline certificate management, we are moving RCStream behind our misc caching cluster, which will allow us to use the wildcard certificate[3] for *.wikimedia.org, making the RCStream-specific certificate redundant. This will reduce operating costs and improve performance in certain cases. == When will this happen? == June 23rd. == How could this affect me? == This change requires updating the DNS record for stream.wikimedia.org. We do not expect any service disruptions. It is conceivable (but unlikely) that you will need to restart your client. If your client is based on one of the published examples[4], you should be fine. If you are not sure, feel free to get in touch with me (ori(a)wikimedia.org). If you are connecting to RCStream over an insecure (http) connection, now would be a great time to migrate to https. http access to RCStream will eventually be disabled; migrating now will protect you from any interruptions down the line. In most cases, making your client use https is as simple as prefixing 'stream.wikimedia.org' with 'https://'. Sample client code on Wikitech[4] has been updated. == How can I track this work? == By following https://phabricator.wikimedia.org/T134871. [1]: https://wikitech.wikimedia.org/wiki/RCStream [2]: https://en.wikipedia.org/wiki/Public_key_certificate [3]: https://en.wikipedia.org/wiki/Wildcard_certificate [4]: https://wikitech.wikimedia.org/wiki/RCStream#Clients

1 0

Recent authentication session instability (was Re: Update from the Wikimedia Performance Team)
by Bryan Davis 19 Jun '16

19 Jun '16

On Thu, Feb 4, 2016 at 8:20 AM, MZMcBride <z(a)mzmcbride.com> wrote: > Federico Leva (Nemo) wrote: >>Login pretty much never does what I expect nowadays, but I'm not sure my >>expectations are correct so I can't identify actual bugs. > > There are various open tasks in Phabricator about user sessions currently, > such as <https://phabricator.wikimedia.org/T124440>. Being unexpectedly > logged out lately has been a bit annoying, though I don't know if it's > related to the Performance team or some other team. The origin of the unexpected logouts falls on the AuthManager project and specifically the SessionManager component that rolled out in 1.27.0-wmf.11 [0]. We had various issues related to the session handling changes including a bug that was overloading the storage capacity of the Redis servers that store session data [1] and two other issues which required rolling the wikis back to 1.27.0-wmf.10 [2][3]. Both rollbacks were accompanied by a run of the "resetGlobalUserTokens.php" maintenance script which updates each user's CentralAuth records in such a way that their authentication session will be considered invalid the next time it is used on a wiki. This was done from an abundance of caution point of view concerning possible issues with sessions that had been issued by the SessionManager software. The reset script is not fast [4], so session invalidation has slowly worked its way across the CentralAuth user table. Part of the enhancements that are being applied in order to bring SessionManager back to production with 1.27.0-wmf.13 is a new config setting that can be used to give us a nearly instant switch to throw to invalidate all active sessions. This setting is actually included in 1.27.0-wmf.12, but the configuration on the Wikimedia cluster has not been changed to make use of it yet. Invalidating all user sessions is not something we plan to do for fun certainly, but there have been in the past (and likely will be in the future) software and configuration issues that necessitate the use of that heavy hammer approach. [0]: https://phabricator.wikimedia.org/T123451 [1]: https://phabricator.wikimedia.org/T125267 [2]: https://wikitech.wikimedia.org/wiki/Incident_documentation/20160123-Session… [3]: https://tools.wmflabs.org/sal/log/AVKZtfQXW8txF7J0uNE2 [4]: https://phabricator.wikimedia.org/T124861 Bryan -- Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org> [[m:User:BDavis_(WMF)]] Sr Software Engineer Boise, ID USA irc: bd808 v:415.839.6885 x6855

7 13

Discovery Weekly Update for the week starting 2016-06-13
by Chris Koerner 19 Jun '16

19 Jun '16

Hello, >From the Wikimedia Foundation Discovery department here's this week's updates. * The Portal team turned off A/B test for languages by article count new display [1] * Portal team turned on survey for question 'how did you arrive at wikipedia.org' (second running of survey) [2] * Maps has moved to shiny new servers [3] * Wikidata and Commons can now use maps [4] [5] * Russian Wikivoyage has switched to the new <mapframe>/<maplink>s * Various Discernatron updates: Default snippets open, open/close all snippets button, larger click area for open/close snippet, snippet highlighting * Started AB test for interwiki search based on language detection on enwiki, frwiki, eswiki, dewiki and itwiki * Did you know? Wikimedia wikis see about 31M full text searches a day. [1] https://phabricator.wikimedia.org/T131526 [2] https://phabricator.wikimedia.org/T136874 [3] https://phabricator.wikimedia.org/T137620 [4] https://phabricator.wikimedia.org/T138030 [5] https://phabricator.wikimedia.org/T138029 ---- Feedback and suggestions on this weekly update are welcome! The full update, and archive of past updates, can be found on Mediawiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates -- Yours, Chris Koerner Community Liaison - Discovery Wikimedia Foundation

1 0

Fwd: [Wikimedia Announcements] Individual Engagement Grants program will fund 8 community-led projects
by Pine W 18 Jun '16

18 Jun '16

Forwarding good news. Pine On Jun 18, 2016 08:45, "Marti Johnson" <mjohnson(a)wikimedia.org> wrote: > Hi all, > > > In the latest round of Individual Engagement Grants > <http://meta.wikimedia.org/wiki/Grants:IEG>, 28 eligible proposals were > submitted for review. The committee recommended 8 for funding, with 9 > grantees selected to receive $87,332 overall. WMF has now approved all 8 > grants. Here’s what we’re funding.[1] > > > Online Community Organizing - 2 projects funded > > > * Health images for all > <https://meta.wikimedia.org/wiki/Grants:IEG/Health_images_for_all>: > User:CFCF <https://meta.wikimedia.org/wiki/User:CFCF>, a veteran > Individual Engagement grantee from Medicine Translation Project Community > Organizing > <https://meta.wikimedia.org/wiki/Grants:IEG/Medicine_Translation_Project_Com…>, > will return to IEG to coordinate a multi-strategy initiative to bring > quality medical images to Wikipedia across many languages.[2][3][4] > > > * Effective Engagement with Health Topic Experts using Guided Checklists > <https://meta.wikimedia.org/wiki/Grants:IdeaLab/Effective_Engagement_with_He…> > : > This project will create infrastructure to make it easier for health > specialists to contribute their knowledge to Wikipedia. Through interviews > and research, User:FloNight > <https://meta.wikimedia.org/wiki/User:FloNight> will develop a robust > health topic quality checklist that medical experts would use to guide > their review of health content on Wikipedia, directing them to make high > quality edits. [5][6] > Tools - 6 projects funded > > > * Improve ‘Upload to Commons’ Android App > <https://meta.wikimedia.org/wiki/Grants:IEG/Improve_%27Upload_to_Commons%27_…> > : > > This project will further enhance ‘Upload to Commons > <http://blog.wikimedia.org/2016/03/25/categorizing-commons-android-photos-ea…>,’ > making the Android app more user-friendly by improving categorization tools > and providing tutorials to help new users create more useful content for > Commons.[7][8] > > > * Enhance the ProveIt gadget > <https://meta.wikimedia.org/wiki/Grants:IEG/Enhance_the_ProveIt_gadget>: > > The ProveIt gadget is a reference manager that creates a visual interface > for easily adding and editing references to a Wikipedia article. This > project will optimise the gadget by connecting it with Wikidata to allow > for autocompletion of references with existing data.[9] > > > * Alt text tools: > <https://meta.wikimedia.org/wiki/Grants:IEG/Alt_text_tools>Alternative > texts provide in-context descriptions of images to increase accessibility > for vision-impaired users. This project would create a collection of tools > to allow volunteers to efficiently add and improve text alternatives on > English Wikipedia.[10] > > > * A graphical and interactive etymology dictionary based on Wiktionary > <https://meta.wikimedia.org/wiki/Grants:IEG/A_graphical_and_interactive_etym…> > : > This project will extract etymological relationships from Wiktionary to > build a database designed for integration into Wikidata. The database will > allow extraction of interesting information like how pronunciations or > semantics evolved through time across etymological trees and across > languages.[11] > > > * Wikiscan Multi-wiki > <https://meta.wikimedia.org/wiki/Grants:IEG/Wikiscan_multi-wiki>: > > This project will expand the Wikiscan site <http://fr.wikiscan.org/>, > currently focused on French Wikipedia, to include all Wikimedia wikis with > more than 100,000 edits. It will provide many daily-updated statistics, > such as most active pages and users for each day and month since a project > was created.[12][13] > > > * Lua libs for behavior-driven development > <https://meta.wikimedia.org/wiki/Grants:IEG/Lua_libs_for_behavior-driven_dev…> > : > > This project will create an extension to support testing of Lua-modules in > a behavior-driven development > <https://en.wikipedia.org/wiki/en:behavior-driven_development> style > using spec-like tests.[14] > > > More information about this round will be covered shortly on the Wikimedia > Foundation blog. > > > The open call for Project Grants > <https://meta.wikimedia.org/wiki/Grants:Project>, which will replace IEG > in the next round, is scheduled for 1 July-2 August, 2016.[15] > > > Congratulations to the successful grantees! > > > > 1. > > <https://meta.wikimedia.org/wiki/Grants:IEG> > 2. > > <https://meta.wikimedia.org/wiki/Grants:IEG/Health_images_for_all> > 3. > > <https://meta.wikimedia.org/wiki/User:CFCF> > 4. > > < > https://meta.wikimedia.org/wiki/Grants:IEG/Medicine_Translation_Project_Com… > > > 5. > > < > https://meta.wikimedia.org/wiki/Grants:IdeaLab/Effective_Engagement_with_He… > > > 6. > > <https://meta.wikimedia.org/wiki/User:FloNight> > 7. > > < > https://meta.wikimedia.org/wiki/Grants:IEG/Improve_%27Upload_to_Commons%27_… > > > 8. > > < > http://blog.wikimedia.org/2016/03/25/categorizing-commons-android-photos-ea… > > > 9. > > <https://meta.wikimedia.org/wiki/Grants:IEG/Enhance_the_ProveIt_gadget> > 10. > > <https://meta.wikimedia.org/wiki/Grants:IEG/Alt_text_tools> > 11. > > < > https://meta.wikimedia.org/wiki/Grants:IEG/A_graphical_and_interactive_etym… > > > 12. > > <https://meta.wikimedia.org/wiki/Grants:IEG/Wikiscan_multi-wiki> > 13. > > <http://fr.wikiscan.org/> > 14. > > < > https://meta.wikimedia.org/wiki/Grants:IEG/Lua_libs_for_behavior-driven_dev… > > > 15. <https://meta.wikimedia.org/wiki/Grants:Project> > > > > > *Marti JohnsonProgram Officer* > *Individual Grants* > *Wikimedia Foundation <http://wikimediafoundation.org/wiki/Home>* > +1 415-839-6885 > Skype: Mjohnson_WMF > > Imagine a world in which every single human being can freely share > <http://youtu.be/ci0Pihl2zXY> in the sum of all knowledge. Help us make > it a reality! > Support Wikimedia <https://donate.wikimedia.org/> > > _______________________________________________ > Please note: all replies sent to this mailing list will be immediately > directed to Wikimedia-l, the public mailing list of the Wikimedia > community. For more information about Wikimedia-l: > https://lists.wikimedia.org/mailman/listinfo/wikimedia-l > _______________________________________________ > WikimediaAnnounce-l mailing list > WikimediaAnnounce-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikimediaannounce-l > >

1 0

New mirror of 'other' datasets
by Ariel Glenn WMF 17 Jun '16

17 Jun '16

I'm happy to announce a new mirror for datasets other than the XML dumps. This mirror comes to us courtesy of the Center for Research Computing, University of Notre Dame, and covers everything "other" [1] which includes such goodies as Wikidata entity dumps, pageview counts, titles of all files on each wiki (daily), titles of all articles of each wiki (daily), and the so-called "adds-changes" dumps, among other things. You can access it at http://wikimedia.crc.nd.edu/other/ so please do! Ariel [1] https://dumps.wikimedia.org/other/

2 2

← Newer
1
2
3
4
5
6
7
8
9
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l June 2016