Wikitech-l August 2017

wikitech-l@lists.wikimedia.org

63 participants
72 discussions

Re: [Wikitech-l] Audiences Q4 FY1617 Quarterly Check-In slides & notes
by Amanda Bittaker 10 Aug '17

10 Aug '17

> > 2b. I like the chart on page page 24 that attempts to show organizational > relationships for the Structured Data project. Who created that chart? > Could Wikimedia affiliate organizations be added as a box on that chart, > and then could the chart's creator upload it as a standalone file to > Commons (if it's not already there)? > Hullo Pine, I made this chart. It's not on Commons yet but I can upload it once this edit is done. The chart is a visual representation of groups that are affected by decisions made about the Structured Data on Commons program. In that context, where would you place Wikimedia Affiliates? Some affiliates are program organizers and/or tool developers, some have strong contingents of Commonists, all certainly contain Wikimedians. Is there another way Wikimedia Affiliates are affected by Structured Data on Commons that is not included in these groups? Cheers, Amanda From: Pine W <wiki.pine(a)gmail.com> > Date: Mon, Aug 7, 2017 at 7:20 PM > Subject: Re: [Wikitech-l] Audiences Q4 FY1617 Quarterly Check-In slides & > notes > To: Wikimedia developers <wikitech-l(a)lists.wikimedia.org> > > > Grace, thanks for publishing these. I have a few questions and comments. > > 1. I have no questions regarding the first slide deck, and I found that it > was informative for me. > > 2. Regarding the second slide deck: > > 2a. I like the Causegraph visualization > > 2b. I like the chart on page page 24 that attempts to show organizational > relationships for the Structured Data project. Who created that chart? > Could Wikimedia affiliate organizations be added as a box on that chart, > and then could the chart's creator upload it as a standalone file to > Commons (if it's not already there)? > > 2c. It looks like > https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_ > Plan/Quarterly_check-ins/Audiences2_Notes_July_2017 > is incomplete; could someone please add the remaining notes? > > 2d. I'd appreciate more information about on how much money (including > money for WMF staff time) is being spent on on-the-ground awareness > campaigns in India and Nigeria, and what the SMART goals are for these > projects. Could someone provide that information? > > Thanks, > > Pine > > > On Mon, Aug 7, 2017 at 2:17 PM, Grace Gellerman <ggellerman(a)wikimedia.org> > wrote: > > > Hi, Wikitech-l > > > > Slide decks and notes from recent Audiences Quarterly Check-Ins are > posted > > as follows: > > > > Audiences 1 (Comm. Tech, Comm. Health, Contributors, Design, & Business > > Ops): > > slides > > <https://commons.wikimedia.org/wiki/File:(PUBLIC_VERSION) > > _Audiences_1_(Community_Tech,_Community_Health,_Contributors,_Audiences_ > > Design,_Audiences_Operations)_Quarterly_Check-in,_July_2017.pdf> > > & notes > > <https://meta.wikimedia.org/wiki/Wikimedia_Foundation_ > > Annual_Plan/Quarterly_check-ins/Audiences1_Notes_July_2017> > > > > > > Audiences 2 (New Readers, Readers, Structured Data, Wikidata) > > slides > > <https://commons.wikimedia.org/wiki/File:Audiences_2_( > > New_Readers,_Structured_Data_on_Commons,_Wikidata,_%26_ > > Readers)_Quarterly_Check-in,_July_2017.pdf > > <https://commons.wikimedia.org/wiki/File:Audiences_2_%28New_ > Readers,_Structured_Data_on_Commons,_Wikidata,_%26_ > Readers%29_Quarterly_Check-in,_July_2017.pdf> > > > > > & notes > > <https://meta.wikimedia.org/wiki/Wikimedia_Foundation_ > > Annual_Plan/Quarterly_check-ins/Audiences2_Notes_July_2017> > > . > > > > These and other links are also posted on the quarterly checkin page > > <https://meta.wikimedia.org/w/index.php?title=Wikimedia_ > > Foundation_Annual_Plan/Quarterly_check-ins&wteswitched=1# > Fourth_quarter_. > > 28April.E2.80.93June_2017.29> > > . > > > > Thanks, > > Grace > > _______________________________________________ > > Wikitech-l mailing list > > Wikitech-l(a)lists.wikimedia.org > > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > _______________________________________________ > Wikitech-l mailing list > Wikitech-l(a)lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > > > > -- > *Anne Gomez* // Senior Program Manager, New Readers > <https://meta.wikimedia.org/wiki/New_Readers> > https://wikimediafoundation.org/ > > > *Imagine a world in which every single human being can freely share in the > sum of all knowledge. That's our commitment. Donate > <http://donate.wikimedia.org>. * > > >

2 1

2017-08-09 Scrum of Scrums meeting notes
by Grace Gellerman 09 Aug '17

09 Aug '17

https://www.mediawiki.org/wiki/Scrum_of_scrums/2017-08-09 = *2017-08-09 =* == Callouts == * Ops: Readers eng need a user account for uploading zim collections to beta/prod Swift (https://phabricator.wikimedia.org/T172735 ) == Audiences == === Readers === ==== iOS native app ==== * Blocked by: none * Blocking: none * Updates: Releasing 5.6.0 ( Reading themes, on this day https://phabricator.wikimedia.org/project/view/2701/ ), Starting work on 5.6.1 ( minor bug fixes, any crash fixes https://phabricator.wikimedia.org/project/view/2898/ ) ==== Android native app ==== * *Blocked by:* Ops: need a user account for uploading zim collections to beta/prod Swift (https://phabricator.wikimedia.org/T172735 ) * *Blocking:* n/a * Updates: ** Cookie beta release occurred! https://phabricator.wikimedia.org/project/view/2763/ Hopefully this release will resolve the issues people are reporting with offline saved pages. ** Offline compilations client-side work is nearly complete, only minor onboarding/branding updates needed – https://phabricator.wikimedia.org/project/view/2833/ *** Work on offline compilation file generation and storage is underway ( https://phabricator.wikimedia.org/T170843 ) ** Two new app engineers starting Monday 8/21! ==== Reading Infrastructure ==== * Blocked by: * Blocking: * Updates: ** Gergo on vacation until Wikimania ** Bernd on vacation until next week ==== Multimedia ==== * Hiring: Progressing well, should have full capacity relatively soon * Next week offsite (hopefully with entire team) * 3D work is nearly done from the technical side, pending design and legal review we'll start pushing out soon. * Wikilegal posting for 3D files is out - https://meta.wikimedia.org/wiki/Wikilegal/3D_files_and_3D_printing * MP3 discussion on Commons also coming up soon - draft at https://commons.wikimedia.org/wiki/User:CKoerner_(WMF)/MP3_patrol_discussion ==== Web ==== Same as usual: * Preparation work for new page summary API * MCS is no longer using MobileView API (but still needs to be deployed) * Desktop print styles * Deploying Page previews to all projects but enwiki and dewiki (likely to be stalled until post Wikimania) ==== Discovery ==== * working on AB test to add thumbnails to search results https://phabricator.wikimedia.org/T149811 === Community Tech === * Deployed CodeMirror, then undeployed. Problems resolved, will try again soon. * LoginNotify coming next week. * Work continues on ArticleCreationWorkflow and GlobalPreferences === Search Platform === * Blocked by: none * Blocking: none * Updates: ** Continuing work on ML-assisted ranking ** Enabled A/B test with interleaving search results ( https://phabricator.wikimedia.org/T150032 ) ** Running human graded relevancy test ( https://phabricator.wikimedia.org/T171740 ) ** Vietnamese analyzer plugin test round 2 finished, getting better but still not ready (https://phabricator.wikimedia.org/T170423#3502328 ) ** WDQS now has per-client request throttling === Contributors === ==== Global Collaboration ==== ===== Collaboration ===== * Blocking - WIP on Flow fix needed by dumps team * Updates * RCFilters - Various updates, especially regarding Live Update. ** Bring back old vs new marker in live update ** RCFilters: Show "from" link when live update is not available ** Allow non-sticky filters to be excluded from saved queries ** Correct label for "View newest changes" button ** RCFilters: Remove new changes visual cue for Live Update feature ** Fix overzealous addQuotes for rc_source field in rebuildrecentchanges.php ** RCFilters: Prevent live update fetch if model is in conflict ** RCFilters: Adjust styling of 'other review tools' button ** RCFilters: Normalize 'limit' to minimum 0, like the backend does ** RCFilters: Adjust server default variable names for limit/days ** RCFilters: Normalize user-generated default values ** RCFilters: set live update button title ** RCFilters: Add vendor prefixes to loading animation ** RCFilters: Add 'enhanced' view (Group by pages) ** RCFilters: Normalize arbitrary values before adding them ** RCFilters: Don't reload results for redundant requests ** RCFilters: Add 'advanced filters' label to the view selection ** RCFilters: Unsticky the 'limit' preference temporarily ** RCFilters: Trim results to allow searching for spaces after trigger ** RCFilters: Scroll widget to top when switching view ** RCFilters: Pluralize 'show last X changes' message == Technology == === Services === * Blockers: none * Updates: ** Alpha version of *recommendation API* deployed https://en.wikipedia.org/api/rest_v1/#!/Recommendation/get_data_recommendat… *** Wikidata query service is contacted in codfw and some testing Discovery is doing makes it timeout ** Job event production rolled out on group0, group1 today ** Use cases for delayed jobs. Please help to discover them *** https://phabricator.wikimedia.org/T172832 === Analytics === * snapshots 2017-07 of the mediawiki_history table is ready, and includes all wikis. This is the first time we have all wikis in this fully publicly shareable denormalized history of all edit metadata. * Ongoing work to rebuild kafka cluster, just upgraded varnishkafka to be able to use TLS * Found a small issue with the way kafka2sse (EventStreams) uses librdkafka, working on deploying now to scb. Until then, we may be losing one or two events there due to an interaction between varnishkafka and librdkafka * Still one person short due to paternity leave * Added continous integration to wikistats 2.0 UI, still evaluating usage of diffusion/differential over gerrit * Eventlogging purging ongoing, really slow on one of the slaves, we need to free disk space faster to not run into disk issues so older eventlogging schemas with loads of data not frequently used will be archived in hadoop. For example: https://phabricator.wikimedia.org/T170720 * Waiting for reading Data analyst to vet family wide (*.wikipedia.org) unique devices metric. * Upgraded Druid storage to 0.9.2 to be able to test metric calculation for edit metrics using data from Edit Data Lake, performance of groupBy is much better

1 0

Wikidata Query Service and SPARQL endpoint usage limits
by Deborah Tankersley 09 Aug '17

09 Aug '17

Due to some continued overuse of the Wikidata Query Service, and the SPARQL endpoint, we recently implemented a throttling feature to prevent users and bots from using too many resources on the servers. Here are the new limits: * any user that is identified by IP and User Agent, can use the service for 60 seconds of query time per minute (burst at 120 seconds per minute) * any user query can generate up to 30 errors per minute (burst to 60 errors per minute) Please let us know if there are questions or concerns with the new usage limits, as we are able to fine tune them if it is causing problems with reasonable use cases. Thanks for your understanding! -- deb tankersley irc: debt Product Manager, Discovery Wikimedia Foundation

1 0

Phabricator monthly statistics - 2017-07
by communitymetrics＠wikimedia.org 09 Aug '17

09 Aug '17

Hi Community Metrics team, This is your automatic monthly Phabricator statistics mail. Accounts created in (2017-07): 432 Active Maniphest users (any activity) in (2017-07): 888 Task authors in (2017-07): 499 Users who have closed tasks in (2017-07): 280 Projects which had at least one task moved from one column to another on their workboard in (2017-07): 293 Tasks created in (2017-07): 2776 Tasks closed in (2017-07): 2267 Open and stalled tasks in total: 35271 Median age in days of open tasks by priority: Unbreak now: 18 Needs Triage: 297 High: 536 Normal: 727 Low: 973 Lowest: 954 (How long tasks have been open, not how long they have had that priority) Active Differential users (any activity) in (2017-07): 24 TODO: Numbers which refer to closed tasks might not be correct, as described in https://phabricator.wikimedia.org/T1003 . Yours sincerely, Fab Rick Aytor (via community_metrics.sh on phab1001 at Tue Aug 8 03:54:29 UTC 2017)

4 3

What makes a high quality MediaWiki extension so nice?
by Legoktm 09 Aug '17

09 Aug '17

Hi, I've proposed a roundtable like discussion for the Hackathon on Thursday to discuss what makes high quality extensions so nice. The goal is to collect a list of things that developers like and look for when reviewing extensions, as advice for newer developers. Even if you aren't able to attend in person, you can leave suggestions in the comments at <https://phabricator.wikimedia.org/T172845>. See you then! -- Legoktm

1 0

Audiences Q4 FY1617 Quarterly Check-In slides & notes
by Grace Gellerman 09 Aug '17

09 Aug '17

Hi, Wikitech-l Slide decks and notes from recent Audiences Quarterly Check-Ins are posted as follows: Audiences 1 (Comm. Tech, Comm. Health, Contributors, Design, & Business Ops): slides <https://commons.wikimedia.org/wiki/File:(PUBLIC_VERSION)_Audiences_1_(Commu…> & notes <https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/Quarterly_…> Audiences 2 (New Readers, Readers, Structured Data, Wikidata) slides <https://commons.wikimedia.org/wiki/File:Audiences_2_(New_Readers,_Structure…> & notes <https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/Quarterly_…> . These and other links are also posted on the quarterly checkin page <https://meta.wikimedia.org/w/index.php?title=Wikimedia_Foundation_Annual_Pl…> . Thanks, Grace

3 3

TechCom Radar, 2017-08-02 (was: ArchCom Radar)
by Daniel Kinzler 08 Aug '17

08 Aug '17

Hi all! Due to Wikimania coming up, the TechCom Radar email is coming very late this time. Sorry about that! Here are the minutes from this week's TechCom meeting. You can also find the minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/2017-08-02>. See also the TechCom activity page on the RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. Here are the minutes, for your convenience: * Discussion of talk pages and contributions for IPv6 ranges happened on August 2nd, but the RFC’s author wasn’t present. The log is linked on the ticket. <https://phabricator.wikimedia.org/T171382#3496647 > * New RFC by MaxSem: Require PHP 5.6 for MediaWiki 1.31 (target summer of 2018): <https://phabricator.wikimedia.org/T172165> * TechCom will host a session about the new charter during the Wikimania Hackathon. <https://www.mediawiki.org/wiki/Talk:Architecture_committee/Charter> * The next TechCom meeting on August 9th will be a public in-person meeting at the Wikimania hackathon, at 4pm local time (that’s 1pm PDT and 20:00 UTC). This is a TechCom planning meeting, not an RFC discussion. Remote participation will be possible (probably via Google Hangout). Watch for aqn announcement in the Hackathon unconference programme. <https://wikimania2017.wikimedia.org/wiki/Hackathon/Program> * There will be no RFC discussion on August 16th, since most TechCom members will be busy with post-Wikimania activities or travel. TechCom Will resume its regular schedule on August 23rd, the next RFC discussion will probably be on August 30th. -- Daniel Kinzler Principal Platform Engineer Wikimedia Deutschland Gesellschaft zur Förderung Freien Wissens e.V.

1 0

Discovery Weekly Update for the week starting 2017-07-31
by Chris Koerner 07 Aug '17

07 Aug '17

Hello all, Here is the Discovery weekly update for 2017-07-31. As always, feedback and questions are welcome. Programming note: We'll be spending our time and attention for the next week at Wikimania (well a sizable number of us). As such, Discovery weekly updates will return the week of 14 August. == Highlights == * 2016/17 Q4 Metrics for the Discovery Department were presented on Aug 3, 2017 * The Audiences 2 (New Readers, Structured Data on Commons, Wikidata, & Readers) Quarterly Check-in, July 2017, has been published that contains the Discovery Department's update. [0] == Discussions == === Search === * Archive search on Special:Undelete enabled everywhere by Stas. [1] * We began a search relevance test to see if we could get good feedback, based on (initial) canned queries (Erik was the key person on this test to get grading feedback from humans on search results) [2] * David fixed a bug where reusing the ScriptService was hitting a circuit breaker which prevented large featuresets to be compiled in one row [3]. This isn't complete deployed yet, due to needing a new plugin version to be added into production first. * Guillaume and Chris J helped with a big issue due to some elasticsearch servers in eqiad overheating (applied thermal paste) [4] * Trey completed another round of testing and analysis on the updated Vietnamese language plugin; we're still not able to deploy it, but it has improved. We may try again later after more updates. [5] === Analysis === * Mikhail and Chelsy worked diligently on getting metrics for the Discovery Department's Q4 2016/2017 slide deck ready for delivery [6] === Maps === * Enabled mapframe for ptwikipedia, euwikipedia and uawikimedia projects (thanks, Maxǃ) [7] [0] https://commons.wikimedia.org/wiki/File%3AAudiences_2_(New_Readers%2C_Struc… [1] https://phabricator.wikimedia.org/T163235 [2] https://phabricator.wikimedia.org/T171740 [3] https://phabricator.wikimedia.org/T17157 [4] https://phabricator.wikimedia.org/T168816 [5] https://phabricator.wikimedia.org/T170423#3502328 [6] https://phabricator.wikimedia.org/T171528 [7] https://phabricator.wikimedia.org/T171805 --- The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Liaison Wikimedia Foundation

1 0

Creation of a Program Committee for Wikimedia developer events
by Quim Gil 04 Aug '17

04 Aug '17

Hi, I just proposed a session for the Wikimania Hackathon next week: Creation of a Program Committee for Wikimedia developer events https://phabricator.wikimedia.org/T160996 All the details are in the task. I am mentioning this here to promote the session among those of you joining the hackathon in Montreal next week, but most importantly to encourage feedback and discussion before the session and by anyone anywhere. Preferably in the task itself, to avoid fragmentation. -- Quim Gil Engineering Community Manager @ Wikimedia Foundation http://www.mediawiki.org/wiki/User:Qgil

1 0

HTML5 sections update
by Max Semenik 04 Aug '17

04 Aug '17

Hey, yesterday the patch implementing human-readable section IDs [0] was merged (thanks, Tim!). The new feature has already been enabled on beta cluster and you can try it yourselves, e.g. on [1] - some pages might still have old HTML cached though and require a null edit to update. What's next? We can probably flip it on testwiki after Wikimania, but further deployments depend on Reading Web, Apps and Parsoid teams. We, however, can already encourage editors to check it out in staging. Unanswered question: do we really need to percent-encode the IDs? There is extensive discussion of that in the aforementioned task, concluding that percent-encoding is probably more "correct". However, not escaping it gives much better browser compatibility (close to 100%). We can change this at any time because no links will be broken due to the way browsers handle percent-encoded fragments. What's the impact for end users? When the commit above goes live, there will be no user-visible changes, and almost no HTML changes at all (only some interface IDs/classes generated from MediaWiki messages might slightly change, but no links will be broken). When we migrate we will initially enable new IDs as a fallback. After 1 month, the new IDs will become default while old ones will be used as a fallback. This way, old links will continue to work, and we have no plans to disable the fallbacks in the foreseeable future. What's the impact for developers? Sanitizer::escapeId() has been deprecated, all code should migrate to escapeIdForAttribute(), escapeIdForLink() or escapeIdForExternalInterwiki(). Warning: unlike escapeId(), these functions' output is not guaranteed to be HTML-safe so it must be escaped. Our security guidelines say that everything should be HTML-safe anyway, so even escapeId() should be properly escaped. The same deprecation happened in JavaScript, mw.util.escapeId() is also deprecated. ---- [0] https://phabricator.wikimedia.org/T152540 [1] https://ru.wikipedia.beta.wmflabs.org/wiki/%D0%92%D0%B8%D0%BA%D0%B8%D0%BF%D… -- Best regards, Max Semenik ([[User:MaxSem]])

3 4

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l August 2017