Wikitech-l November 2018

wikitech-l@lists.wikimedia.org

51 participants
69 discussions

Audiences Q1 FY1819 Quarterly Check-In slides & notes

by Megan Neisler

Hi, Wikitech-l Slide decks and notes from recent FY18/19 Q1 Audiences Quarterly Check-Ins are posted as follows: Audiences Session 1: Slides: https://commons.wikimedia.org/wiki/File:Audiences_Session_1_October_2018_Qu… Notes: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/Quarterly_… Audiences Session 2: Slides: https://commons.wikimedia.org/wiki/File:Audiences_Session_2_October_2018_Qu… Notes: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/Quarterly_… These and other links are also posted on the quarterly check-in page. https://meta.wikimedia.org/w/index.php?title=Wikimedia_Foundation_Annual_Pl… Thanks, Megan -- Megan Neisler Senior Project Coordinator - Audiences & Technology Wikimedia Foundation

5 years, 5 months

2018-10-31 Scrum of Scrums meeting notes

by Grace Gellerman

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-10-31 =2018-10-31= == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar * Release Engineering: train blocked on T208398 Fatal error on testwiki on viewing talk pages when blocked and logged in * Community Tech: The 2019 community wishlist survey has begun! Please submit proposals and participate in the discussions! https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2019 == Audiences == === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** The 2019 community wishlist survey has begun! https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2019 ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** Partial Blocks code is out and rode the train; We're going to enable the interface on test wiki today or tomorrow. ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** ==== Growth ==== * Blocked by: * Blocking: * Updates: ** ==== Language ==== * Blocked by: * Blocking: * Updates: ** Continue working on ContentTranslation version 2 improvments. In details: https://www.mediawiki.org/wiki/Content_translation/V2#October_2018 === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: **6.1.0 in review, will be released after it's approved **6.1.0 won't allow editing wikidata descriptions of English articles - it will be enabled in the next release once English Wikipedia editors are notified (task: https://phabricator.wikimedia.org/T208252) **6.1.1 will be a bug-fix release (release board: https://phabricator.wikimedia.org/tag/ios-app-v6.1.1-narwhal-on-a-magic-pum…) ==== Android native app ==== * Blocked by: * Blocking: * Updates: **Released all the things to production (new navigation design, Echo notifications, etc.) ** https://phabricator.wikimedia.org/diffusion/APAW/history/master/;r/2.7.263-… ==== Readers Web ==== * Blocked by: * Blocking: * Updates: **At Wikimedia Technical Conference and team offsite ==== Readers Infrastructure ==== * Blocked by: n/a * Blocking: n/a * Updates: ** MCS/PCS: *** Working on fixing performance problems caused by CPU-bound work ( https://phabricator.wikimedia.org/T202642 ) *** PCS mobile-html: working on a strategy for handling i18n in shared mobile page content composed on the server ( https://phabricator.wikimedia.org/T205550 ) ** Maps: *** Fixing tilerator crash caused when attempting to access data subject to a lock in Postgres (https://phabricator.wikimedia.org/T204047 ) *** The Stretch upgrade/data loading on the maps cluster continues ( https://phabricator.wikimedia.org/T205462 ) ** Admin: *** New (properly registered) team IRC channel: #wikimedia-infrastructure ==== Multimedia ==== * Updates ** Matthias's baby has arrived, so we're pretty short-staffed atm ** hiring continues ** SDoC: First prototype enabled on beta, being tested ** SDoC: Working on UI/copy feedback, virtual statements, 'depicts' in UW, metrics ==== Parsing ==== * Blocked by: * Blocking: * Updates: ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Druid cluster upgrade, now Turnilo supports monthly granularity visualizations ** Fixed vulnerabilities of all our node projects ** Productionized automatic ingestion of NavigationTiming, ReadingDepth and PageIssues EL schemas into Druid/Turnilo ** As part of migration from stat1005 to stat1007, moved users and home folders, stat1005 is not to be used any more! ** Working on deprecating the reportcard in favor of Wikistats2 === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** CiviCRM: follow-on work to distinguish endowment donations ** CiviCRM: expanding donor data export / deletion extension ** CentralNotice backend maintenance work ** Dealing with PayPal's poorly timed recurring payment ID migration === MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** === Performance === * Blocked by: ** * Blocking: ** * Updates: ** === Release Engineering === * Blocked by: ** train blocked on T208398 Fatal error on testwiki on viewing talk pages when blocked and logged in ** For fundraising, we need to upgrade composer merge plugin for Donation interface and mediawiki/vendor@fundraising/RE1_27 https://phabricator.wikimedia.org/T203084 *** Need a sync up with Antoine "hashar" Musso next week. * Blocking: ** Train Health: *** Last week: 1.33.0-wmf.1 deployment blockers https://phabricator.wikimedia.org/T206655 **** Six blockers closed, one opened on friday after conclusion of the train **** Group1 was delayed until Thursday and Group2 finally happened late Thursday evening. **** Otherwise it was a mostly uneventful train. The blockers were perhaps more worrisome than destructive, no outages occurred. *** This week: 1.33.0-wmf.2 deployment blockers https://phabricator.wikimedia.org/T206656 **** T208398 Fatal error on testwiki on viewing talk pages when blocked and logged in === Research === * Blocked by: None * Blocking: None * Updates: ** Writing papers for the Web Conference ** Working on the 3-5 year plan ** Starting a new online experiement for the "Elicit new editor interest" research project: https://meta.wikimedia.org/wiki/Research:Voice_and_exit_in_a_voluntary_work… === Scoring Platform === * Blocked by: DBAs: Need that DDL reviewed: https://phabricator.wikimedia.org/diffusion/EJAD/browse/master/sql/ * Blocking: None (hopefully) * Updates: ** Logstash fixes going live today ** Upgrade to celery 4 will gets deployed today ** upgrading flask to 0.12.4 will go live soon === Search Platform === * Blocked by: * Blocking: * Updates: ** === Security === * Blocked by: None * Blocking: T207798Security review for GrowthExperiments extension * Updates:T207798Security review for GrowthExperiments extension is in progress ** === Services === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** Auditing all varnish fronted services for lack of TLS by SRE traffic team, you could be pinged. == Wikidata == * Blocked by: * Blocking: * Updates: ** == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** == SoS Meeting Bookkeeping == * Updates: **

5 years, 5 months

Discovery Weekly Update for the week starting 2018-10-22

by Chris Koerner

This is the weekly update from the Search Platform team for the week starting 2018-10-22. As always, feedback and questions welcome. == Discussions == === Search === * Mathew and Gehel worked on refactoring the WDQS updater while also increasing the restart interval of the WDQS updater [0] [1] *There were some known issues that the Search team helped in fixing where the Elasticsearch puppet config changes broke puppet in various instances [2] *Erik fixed an issue where the sister search / cross language search interaction with multi-datacenter was a bit off [3] *The team worked on getting Debian Stretch off of Ubuntu Trusty for all instances of the search project [4], as well as various other updates needed to get ElasticSearch ready for version 6: as well as investigating just how many number of servers we really need in the ElasticSearch cluster. [5] [6] [7] [8] [9] *Gehel and Mathew also worked on |modifing scap::target to define sudo rules for multiple services [10] *Erik |fixed a failure where cirrusSearchIncomingLinkCount was getting a 'read timeout is reached' issue from title::getFirstRevision [11] *Erik finished up work to add autocomplete evaluation via MRR to relforge [12] == Other Noteworthy Stuff == * Oct 18-21 Trey went to WikiConferenceNA 2018. [13] Some highlights: ** He was interviewed [14] for the Wikijabber podcast. [15] ** He gave a lightning talk on homoglyphs. Slides are available online. [16] ** You can see the full conference schedule online [17] and find the slides for many of the presentations on Commons. [18] ** More detailed write up on MediaWiki. [19] == Did you know? == * Homoglyphs [20] are characters in different writing systems that look very similar or, in some fonts, even identical to each other. For example A/Α/А or M/Μ/М in Latin, Greek, and Cyrillic, respectively. Homoglyphs can be very hard to detect when reading, but they interfere with search because “Мoscow” and “Moscow” are completely different words from the point of view of search. The former starts with a Cyrillic M (as does Moscow’s name in Russian, “Москва”). There are often a few dozen examples of the mixed-script “Мoscow” [21] on English Wikipedia at any given time. (Trey cleans them up from time to time as a hobby, and hopes to create a plugin for Elasticsearch to automatically make them visible to search.) [0] https://phabricator.wikimedia.org/T208392 [1] https://phabricator.wikimedia.org/T207843 [2] https://phabricator.wikimedia.org/T205672 [3] https://phabricator.wikimedia.org/T205558 [4] https://phabricator.wikimedia.org/T204686 [5] https://phabricator.wikimedia.org/T206468 [6] https://phabricator.wikimedia.org/T206469 [7] https://phabricator.wikimedia.org/T206472 [8] https://phabricator.wikimedia.org/T206470 [9] https://phabricator.wikimedia.org/T207724 [10] https://phabricator.wikimedia.org/T206314 [11] https://phabricator.wikimedia.org/T206042 [12] https://phabricator.wikimedia.org/T205494 [13] https://wikiconference.org/wiki/2018/Main_Page [14] https://wikijabber.com/wikijab015-trey-jones/ [15] https://wikijabber.com/ [16] https://docs.google.com/presentation/d/1nQQUJ8W4NK4vf7WbKFp2YZz3Bvej97zRFO4… [17] https://wikiconference.org/wiki/2018/Schedule [18] https://commons.wikimedia.org/wiki/Category:WikiConference_North_America_20… [19] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/WikiConference_North… [20] https://en.wikipedia.org/wiki/Homoglyph [21] https://en.wikipedia.org/w/index.php?search=%D0%9Coscow&title=Special%3ASea… ---- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation

5 years, 5 months

Readers Monthly update for October 2018

by Chris Koerner

Hello, This is the monthly update from the Readers team at the Wikimedia Foundation for October 2018. Feedback and questions are encouraged. ==Discussions== === Apps === * iOS released version 6.1 to the App Store [0], which includes the ability to edit Wikidata sourced descriptions via the app interface, similar to the existing feature on the Android app. This feature is not enabled for English articles due to local community override described on-wiki. [1] === Web === * Wrapping up feedback on navigation prototype [2] ** English Wikipedia Signpost gave some love for our work for mobile contribution tools [3] === Reading Infrastructure === ==== MCS/PCS ==== *Working on fixing performance problems caused by CPU-bound work [4] *PCS mobile-html: working on a strategy for handling i18n in shared mobile page content composed on the server [5] ==== Maps ==== *Fixing Tilerator crash caused when attempting to access data subject to a lock in Postgres [6] *The Stretch upgrade/data loading on the maps cluster continues [7] === New Readers === * New Reader updates can be found at Meta. [8] === Multimedia === * The Structured Data on Commons project shared a prototype of a potential new search interface for content on Commons [9] ** You can keep up-to-date on their work on Commons [10] [0] https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=32471523… [1] https://en.wikipedia.org/wiki/Wikipedia:Short_description [2] https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions/Na… [3] https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2018-10-01/Techn… [4] https://phabricator.wikimedia.org/T202642 [5] https://phabricator.wikimedia.org/T205550 [6] https://phabricator.wikimedia.org/T204047 [7] https://phabricator.wikimedia.org/T205462 [8] https://meta.wikimedia.org/wiki/New_Readers/Updates [9] https://commons.wikimedia.org/wiki/Commons:Structured_data/Get_involved/Fee… [10] https://commons.wikimedia.org/wiki/Commons:Structured_data/Get_involved#Kee… --- Subscribe to receive theses updates as on-wiki notifications or opt-in email. https://www.mediawiki.org/wiki/Newsletter:Readers_Monthly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Reading/Status_updates Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation

5 years, 5 months

quarry.wmflabs.org downtime starting in about an hour

by Andrew Bogott

We'll be shuffling the VMs that host the Quarry service over to a new corner of the cloud today. During the move the service will be unavailable and/or behave erratically. I don't expect the move to take more than an hour. I'll send a further notice when things are done. -Andrew + the WMCS team

5 years, 5 months

Advice on Tuning Search?

by Hogan (US), Michael C

Can anyone point me to a starting point for learning about how to tune CirrusSearch (or examples)? I found the CirrusSearchScoreBuilder page [1], which implies it is possible to modify how search results are ranked. But, the documentation page hasn't been created yet. Thank you! [1]: https://www.mediawiki.org/wiki/Manual:Hooks/CirrusSearchScoreBuilder

5 years, 5 months

TechCom Radar 2018-10-31

by Daniel Kinzler

Hello all, Here are the minutes from this week's TechCom meeting: * Following up on the Technical Conference in Portland (aka TechConf aka WMTC18). Some outcomes: -- We discussed the idea of sharding the revision table, with the big question being what key to shard on. Options include page ID and timestamp. Tim wants to look into this next fiscal. -- People were generally happy with the proposed Architecture Principles. Daniel put some of the feedback we got on the talk page, for discussion: <https://www.mediawiki.org/wiki/Talk:Wikimedia_Technical_Committee/MediaWiki…> -- More results of WMTC to follow over the next few weeks. * TechCom is moving to alternating times for their meetings. The public RFC discussions will alternate between the old time (Wednesday 2pm PST, 23:00 CET) and a new time (Wednesday 11pm PST, Thursday 08:00 CET). Times were chosen to allow people from the US, Europe and Australia to participate. Times may shift again as we get feedback on the new arrangement. * On Friday or Monday we’ll have PHP 7 working on the debug servers. Still figuring out how to select using the browser extension. (Giuseppe) * RFC accepted after last call: Spec for representing multiple content objects per revision (MCR) in XML dumps <https://phabricator.wikimedia.org/T199121>. During the last call, an issue with the representation of content hashes was addressed. For the new XML schema, see <https://www.mediawiki.org/wiki/Requests_for_comment/Schema_update_for_multi…>. Ariel and Daniel to follow up. * RFC accepted after last call: Release notes automation <https://phabricator.wikimedia.org/T200392>. Kunal to follow up. * No public RFC discussion next week. * Upcoming RFC discussion (probably on November 14): Session storage service interface <https://phabricator.wikimedia.org/T206010>. * Upcoming RFC discussion (probably on November 21): Introduce a new namespace for collaborative judgments about wiki entities (JADE) <https://phabricator.wikimedia.org/T200297>. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here: <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> -- daniel

5 years, 5 months

Avatars coming to gerrit

by Paladox

Hi, with https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/464907/ being merged. We are a step closer to enabling avatars. The only changes left to do is https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/456437/ and also installing the plugin. You can begin uploading your avatars to https://gerrit.wikimedia.org/r/#/admin/projects/All-Avatars Note that we will only accept png images. Please do not upload any other format. Note: Image formats are case sensitive so the image must match the username field at https://gerrit.wikimedia.org/r/#/settings/ So for example me (paladox) will be paladox.png. We also have a license file for you to specify the license of your image at https://gerrit.wikimedia.org/r/plugins/gitiles/All-Avatars/+/refs/heads/mas… If none is specified then it defaults to GPL 2.0+. We are using "Trusted-Contributors" for this. So to be able to upload and merge your own change you will need to be in this group. If you would like to be added to this group please reply to this email saying you would like to be added to it. Note all members in "mediawiki" will already be able to merge or add users to these groups, same for admins and ldap/ops (seeing as they are also admins). See task https://phabricator.wikimedia.org/T191183

5 years, 5 months

Phabricator monthly statistics - 2018-10

by communitymetrics＠wikimedia.org

Hi Community Metrics team, This is your automatic monthly Phabricator statistics mail. Accounts created in (2018-10): 381 Active Maniphest users (any activity) in (2018-10): 936 Task authors in (2018-10): 522 Users who have closed tasks in (2018-10): 297 Projects which had at least one task moved from one column to another on their workboard in (2018-10): 300 Tasks created in (2018-10): 2667 Tasks closed in (2018-10): 1992 Open and stalled tasks in total: 40067 Median age in days of open tasks by priority: Unbreak now: 43 Needs Triage: 435 High: 743 Normal: 998 Low: 1331 Lowest: 1275 (How long tasks have been open, not how long they have had that priority) Active Differential users (any activity) in (2018-10): 15 TODO: Numbers which refer to closed tasks might not be correct, as described in https://phabricator.wikimedia.org/T1003 . Yours sincerely, Fab Rick Aytor (via community_metrics.sh on phab1001 at Thu Nov 1 00:00:18 UTC 2018)

5 years, 5 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2018