Wikitech-l November 2018

wikitech-l@lists.wikimedia.org

51 participants
72 discussions

Deployment-prep (aka 'Beta') services will be unreliable this week
by Andrew Bogott 24 Nov '18

24 Nov '18

Due to a lucky arrangement of schedules, we are going to move the deployment-prep project to the new Cloud region this week, starting in a few minutes. *This includes all of the infrastructure behind the beta.wmflabs.org site.* Various people will be standing by to troubleshoot the outages that result, but for the most part if you see bad behaviors you should disregard or work around them for the time being. Once everything is moved and semi-stable I will send a followup email, at which point the deployment-prep team will once again become interested in bug reports :) Sorry for the short notice! With a little luck this should be mostly painless. -Andrew

4 4

The annual Community Wishlist Survey now open for proposals
by Johan Jönsson 23 Nov '18

23 Nov '18

Hey everyone, The Community Wishlist Survey is now open, and you can post proposals for projects that you would like the Wikimedia Foundation's Community Tech team to work on: https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2019 The Community Tech team builds features and makes changes that active Wikimedia contributors want, and the Wishlist Survey sets the team's agenda for the next year. The Wishlist Survey starts with a two-week proposal period, when contributors from all Wikimedia projects are invited to post, discuss and improve proposals. After that, there's a two-week voting period, when everyone can post support-votes on the proposals. You can post technical proposals until 11 November. You can vote on proposals from 16 November to 30 November. The Community Tech team is responsible for addressing the top ten wishes on the list. If they, after investigating it, find that something isn't feasible, they need to explain why to the community. The Wishlist can also be used by volunteer developers and other teams, who want to find projects to work on that the community really wants. //Johan Jönsson --

2 2

2018-11-21 Scrum of Scrums meeting notes
by Grace Gellerman 22 Nov '18

22 Nov '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-11-21 *2018-11-21=* == Callouts == * Release Engineering: No train this week due to the Thanksgiving Holiday * UI Standardization: Feedback welcome on non-proportional, aka monospace font choice for code https://phabricator.wikimedia.org/T209915 == Audiences == === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** Responded to Language's request for feedback ==== Growth ==== * Blocked by: * Blocking: * Updates: ** Recording EventLogging events in MySQL in beta broke multiple times this past week. Perhaps caused by Neutron migration? **EditorJourney schema logging went live on Thursday for Czech and Korean wikis. **WelcomeSurvey is live on cswiki and kowiki despite 2 OOUI bugs: T209716, T209717. (help from anyone that manages OOUI would be great) ==== Language ==== * Blocked by: None * Blocking: None * Updates: ** Apertium and depenencies are updated in Production. ** New shiny graphs for cxserver (service-cxserver) at Graphana available. Helped to identify issues already! ** ContentTranslation v2 bug fixes continue. === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: ** ==== Android native app ==== * Blocked by: * Blocking: * Updates: ** ==== Readers Web ==== * Blocked by: * Blocking: * Updates: ** ==== Readers Infrastructure ==== * Blocked by: * Blocking: * Updates: ** Announcements changes for English app fundraising are deployed. App devs: please test asap. https://phabricator.wikimedia.org/T204821 ==== Multimedia ==== * Updates ** Mostly bugfixing on beta commons - hoping to invite community comment on it real soon (honest!) ** Also working on depicts and other statements ==== Parsing ==== * Blocked by: None * Blocking: None * Updates: None ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** Design Style Guide *** New “Resources” section https://design.wikimedia.org/style-guide/resources.html *** Updates on “Typography” and imagery across pages ** Accessibility: *** Wikipedia Portals freed of technical a11y hurdles == Technology == === Analytics === * Blocked by: performance of cloud replicas for sqooping all rows monthly, ongoing work and discussion at T209031 * Blocking: * Updates: ** testing Kerberos with our infrastructure on cloud VMs, progressing well ** work on Modern Event Platform's Event Intake service code going well. If you want to follow from the very early stages, see https://github.com/ottomata/eventbus ** XML dumps available in HDFS, see T202489 ** ongoing work on sanitizing Hive event database (all EventLogging data) === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** === MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** RFC meeting regarding session storage interface (multi-DC dependency) continuing tomorrow (https://phabricator.wikimedia.org/T206010 ) ** PHP 7.2 tests are now voting for MediaWiki (gerrit:473312) ** Continuing to extract decisions and action items from Tech Conf session notes ** Actor table rolled out to test wikis and mediawiki.org last week, and to group 0 this week. No problems reported ** Comment table image_comment_temp merging is done, except for the WMF schema change (https://phabricator.wikimedia.org/T209591 ). ** Externallinks indexing: DONE! (https://phabricator.wikimedia.org/T209373 ) === Performance === * Blocked by: ** * Blocking: ** * Updates: ** === Release Engineering === * Blocked by: * Blocking: * Updates: ** Hired Jeena Huneidi. She will be working on local development and other developer satisfaction improvements. https://groups.google.com/a/wikimedia.org/d/topic/foundation-optional/5GXGf… ** Blog post by Dan Duvall: Bring in 'da noise, bring in defunct. It's a zombie party! Peering into the CI cauldron – October 2018 https://phabricator.wikimedia.org/phame/post/view/127 ** Thanks to Krenair, Andrew Boggott, and Bryan Davis for helping make the Beta Cluster region migration go as smoothly as possible - https://phabricator.wikimedia.org/T208101 ** CI Nodepool stopped yeah! #technical-debt ** Gerrit is alright. Got JavaMelody for monitoring now. InitialiseSettings.php is too big. ** Blubber build with Blubber ** Code Health: *** Experimenting with SonarQube https://phabricator.wikimedia.org/T207046 ** Train Health: *** Last week: 1.33.0-wmf.4 deployment blockers https://phabricator.wikimedia.org/T206658 *** This week: No train due to the Thanksgiving Holiday *** Next week: 1.33.0-wmf.6 deployment blockers https://phabricator.wikimedia.org/T206660 === Research === * Blocked by: None * Blocking: None * Updates: ** Working on collecting more synonyms for section titles: https://phabricator.wikimedia.org/T210085 ** Preparing to run QuickSurveys for Reader Trust: https://phabricator.wikimedia.org/T209882 === Scoring Platform === * Blocked by: None * Blocking: None * Updates: ** Work on upgrading to celery 4 is officially done ** Jade TechCom RFC discussion coming up regarding JADE storage (22nd @ 0600 UTC) ** Investigating on using redis-sentinel for ores ** Fixed scap restart check for ores-celery === Search Platform === * Blocked by: * Blocking: * Updates: ** Worked with DWIM Gadget authors to improve “wrong keyboard” detection: https://phabricator.wikimedia.org/T138958 ** Fixed prefix search with multiple namespaces: https://phabricator.wikimedia.org/T208255 ** Improved Blazegraph reliability: https://phabricator.wikimedia.org/T206189 ** Setting up A/B test for new wikidata completion models: https://phabricator.wikimedia.org/T209402 ** Working on transforming Elasticsearch explains into tensorflow code: https://phabricator.wikimedia.org/T208917 ** Working on ES 6 upgrade: https://phabricator.wikimedia.org/T183282 ** Working on running multiple Elastic instances on the same hardware: https://phabricator.wikimedia.org/T193654 ** Working on query parsing refactoring: https://phabricator.wikimedia.org/T185108 === Security === * Blocked by: * Blocking: * Updates: Security Engineers are Reviewing Tasks and are expected to complete Reviews on time ** === Services === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** ATS work (replacing varnish) ongoing. Still a long way from complete, just FYI ** zoterov2 successfully deployed in staging, production finally next ** php 7.2 installed on appservers ** A lot of reboots happening, should be transparent == Wikidata == * Blocked by: * Blocking: * Updates: ** == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** working on making AbuseFilter work with MCR: ( https://phabricator.wikimedia.org/T208769) ** discussing MCR support for File page layout: ( https://phabricator.wikimedia.org/T209878) == SoS Meeting Bookkeeping == * Updates: **

1 0

RFC Discussion today: Introduce a new namespace for collaborative judgments about wiki entities
by Kate Chapman 22 Nov '18

22 Nov '18

Hi All, A reminder that TechCom is hosting an IRC meeting today Wednesday November 21st 11pm PST(November 22nd 07:00 UTC, 08:00 CET) in #wikimedia-office on RFC: Introduce a new namespace for collaborative judgments about wiki entities <https://phabricator.wikimedia.org/T200297> The proposal is to create two new namespaces, Judgment and Judgment_talk (exact names to be decided at T200365). In the content namespace, pages will be a JSON description of judgments about wiki entities such as a particular edit. For example, w:en:Judgment:Diff/123457 would have judgments about whether https://en.wikipedia.org/wiki/?diff=123457 is a damaging or good-faith edit, and its talk page the dialogue leading to this consensus. If you haven't joined a #wikimedia-office meeting before more information can be found here <https://meta.wikimedia.org/wiki/IRC_office_hours#How_to_participate> More information regarding the TechCom RFC process is available here <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Processes#RFC_…> Thanks, -Kate -- Kate Chapman Senior Program Manager, Core Platform Wikimedia Foundation kchapman(a)wikimedia.org

1 0

Problem importing images
by nad 21 Nov '18

21 Nov '18

Hi all, I've installed a new 1.31 and imported content from an xml dump using importDump.php which included file descriptions, then imported the images from a directory of files using importImages.php. About half of the files have imported successfully, but the other half say the image is not found when I go to the image page in the wiki. i can see the image in the proper place in the upload directory so it has imported properly. If I try and re-upload the image manually I can't because it says an exact replica already exists, but click on that link to the already existing one still says "No file by this name exists, but you can upload it". I've tried running all the related maintenance scripts such as rebuildImages.php with no success :-( Any ideas? Thanks, Aran

1 0

Wednesday: Technical Advice IRC Meeting
by Michael Schönitzer 20 Nov '18

20 Nov '18

Reminder: Technical Advice IRC meeting again **Wednesday 4-5 pm UTC** on #wikimedia-tech. Question can be asked in English & German. The Technical Advice IRC Meeting is a weekly support event for volunteer developers. Every Wednesday, two full-time developers are available to help you with all your questions about Mediawiki, gadgets, tools and more! This can be anything from "how to get started" over "who would be the best contact for X" to specific questions on your project. If you know already what you would like to discuss or ask, please add your topic to the next meeting: https://www.mediawiki.org/wiki/Technical_Advice_IRC_Meeting Hope to see you there! Michi (for the Technical Advice IRC Meeting crew) -- Michael F. Schönitzer Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin Tel. (030) 219 158 26-0 http://wikimedia.de Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen Wissens frei teilhaben kann. Helfen Sie uns dabei! http://spenden.wikimedia.de/ Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V. Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für Körperschaften I Berlin, Steuernummer 27/681/51985.

1 0

Problem importing images
by Aran 18 Nov '18

18 Nov '18

1 0

Patchsets by new Gerrit contributors waiting for code review and/or merge
by Andre Klapper 18 Nov '18

18 Nov '18

CR0: Please review and provide guidance if you are familiar with the code, and decide (CR±1 or CR±2): * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/AbuseFilter/+/20117… ** Add average AbuseFilter run time and conditions to display table ** 2018-October-16 ** Maintainers/Stewards: MediaWiki Platform team * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/AbuseFilter/+/20117… ** Expand stat tracking in AbuseFilter ** 2018-October-16 ** Maintainers/Stewards: MediaWiki Platform team * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/462155/ ** Adds alternative file icon paths ** 2018-October-14 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/AbuseFilter/+/20110… ** Overhaul AbuseFilter internal profiling system ** 2018-October-24 ** Maintainers/Stewards: MediaWiki Platform team * https://gerrit.wikimedia.org/r/#/c/avro-php/+/466838/ ** Convert Avro-PHP to PSR-Compliant Project ** 2018-Ocotber-18 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/469503/ ** MWExceptionRenderer: Improve the message shown when a database error occurs ** 2018-October-27 ** Maintainers/Stewards: MediaWiki Platform team? * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Echo/+/470729/ ** Update Echo.page.js::check for welcome element, Fix Echo.js::added page load, Add notification_welcome test ** 2018-November-06 ** Maintainers/Stewards: Growth team * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Echo/+/471909/ ** Test: notify a new user with welcome message ** 2018-November-06 ** Maintainers/Stewards: Growth team * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Echo/+/471910/ ** Test: notify a new user with welcome message ** 2018-November-06 ** Maintainers/Stewards: Growth team * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/RevisionSlider/+/47… ** Change color to darker shade ** 2018-November-04 ** Maintainers/Stewards: WMDE Engineering * https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/Material/+/471766/ ** Add scrollbar:: to view more content on sidebar ** 2018-November-06 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/core/+/472491/ ** MediaWiki Special Pages CSS : Add indentation to content under header ** 2018-November-08 ** Maintainers/Stewards: MediaWiki Platform team? CR+1: Please help make a decision (CR±1, CR±2) on these CR+1 patches: * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/VEForAll/+/454560/ ** Fix composer package name to match conventions ** 2018-September-07 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/PluggableAuth/+/468… ** Adding separate option for local API login ** 2018-October-20 ** Maintainers/Stewards: ??? * https://gerrit.wikimedia.org/r/#/c/mediawiki/skins/Refreshed/+/470621/ ** Fix focus on 'More' drop down when tabbing in skin Refreshed. ** 2018-October-31 ** Maintainers/Stewards: ??? Read https://www.mediawiki.org/wiki/Gerrit/Code_review#By_project how you can get notified of new patches in your code areas of interest. Thanks in advance for your reviews! Of last time's 6 listed patches, 2 received reviews by Addshore and Nikerabbit. Maintainers/Stewards data taken from https://www.mediawiki.org/wiki/Developers/Maintainers CR0 source: https://gerrit.wikimedia.org/r/#/q/ownerin:newcomers+status:open+label:Veri… CR+1 source: https://gerrit.wikimedia.org/r/#/q/ownerin:newcomers+status:open+label:Veri… -- Andre Klapper | Bugwrangler / Developer Advocate https://blogs.gnome.org/aklapper/

1 0

TechCom Radar 2018-11-14
by Kate Chapman 18 Nov '18

18 Nov '18

Hi All, Here are the minutes from this week's TechCom meeting: * Hosting IRC meeting next week on Wednesday November 21st 11pm PST(November 22nd 07:00 UTC, 08:00 CET) in #wikimedia-office Introduce a new namespace for collaborative judgments about wiki entities <https://phabricator.wikimedia.org/T200297> * Hosted IRC meeting on: RfC: Session storage service interface <https://phabricator.wikimedia.org/T206010> * minutes: <https://tools.wmflabs.org/meetbot/wikimedia-office/2018/wikimedia-office.20…> * log: <https://tools.wmflabs.org/meetbot/wikimedia-office/2018/wikimedia-office.20…> * Reviewed: RfC: Standards for external services that integrate with MediaWiki <https://phabricator.wikimedia.org/T20852> committee will continue developing a proposal * Closing Add CURRENT_TIMESTAMP <https://phabricator.wikimedia.org/T208487>: in favor of writing new RFC with a different solution to add a new attribute to the watchlist table You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> Thanks, Kate -- Kate Chapman Senior Program Manager, Core Platform Wikimedia Foundation kchapman(a)wikimedia.org

1 0

Fwd: [Cloud] [Cloud-announce] Brief service interruption next Monday 2018-11-19 at 13:00 UTC
by Pine W 17 Nov '18

17 Nov '18

Cross-posting. Pine ( https://meta.wikimedia.org/wiki/User:Pine ) ---------- Forwarded message --------- From: Arturo Borrero Gonzalez <aborrero(a)wikimedia.org> Date: Thu, Nov 15, 2018 at 1:04 PM Subject: [Cloud] [Cloud-announce] Brief service interruption next Monday 2018-11-19 at 13:00 UTC To: <Cloud-announce(a)lists.wikimedia.org> Next monday 2018-11-19 we will be rebooting several Cloud VPS infrastructure servers [0] for maintenance and security updates. This is just a simple reboot of servers and we don't expect any outage or major interruptions, but some services may be down briefly: * Horizon and Wikitech may misbehave * instance creation/deletion/shutdown, etc * CI tests may stop running Apologies in advance for any inconvenience, and please let us know any issue you may find after these operations. [0] cloudcontrol1003, cloudservices1003, labcontrol1001, labservices1001 _______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce _______________________________________________ Wikimedia Cloud Services mailing list Cloud(a)lists.wikimedia.org (formerly labs-l(a)lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2018