Wikitech-l November 2018

wikitech-l@lists.wikimedia.org

51 participants
72 discussions

which programs convert? keep metadata when transforming metadata
by rupert THURNER 06 Nov '18

06 Nov '18

hi, fotos and films are converted quite often in the wikimedia space. metadata is not so often preserved. what programs one would need to adjust to preserve the metadata? i know of ffmpeg for videos. for fotos is it convert from gimp? anything else? some other aspects one would need to pay attention? rupert

2 1

Fwd: [Wikimedia-l] November 30 deadline for new Project Grant proposals
by Pine W 06 Nov '18

06 Nov '18

Cross-posting. Pine ( https://meta.wikimedia.org/wiki/User:Pine ) ---------- Forwarded message --------- From: Chris "Jethro" Schilling <cschilling(a)wikimedia.org> Date: Mon, Nov 5, 2018 at 3:33 AM Subject: Re: [Wikimedia-l] November 30 deadline for new Project Grant proposals To: Wikimedia Mailing List <wikimedia-l(a)lists.wikimedia.org> Hi folks, The open call for Project Grants is officially underway! As you prepare your proposals this month, please keep in mind that the final deadline is November 30th, and that this will be only the only open call for Project Grants during this fiscal year, which ends on June 30th, 2019. To learn more about this grant program and how to prepare an application, please visit our landing page on Meta. < https://meta.wikimedia.org/wiki/Grants:Project> In addition to the resources mentioned in the prior announcement, we have scheduled some proposal clinics where applicants will be able to discuss their proposals or ask questions with Wikimedia Foundation staff using Google Meet or using IRC. Some of these will be themed toward specific topics (such as proposals involving a GLAM-related project), and others will be more general. For a list of scheduled proposal clinics, please review the Project Grants landing page on Meta. < https://meta.wikimedia.org/wiki/Grants:Project#Upcoming_events>. Additional clinics may be added throughout the month. Thanks, Chris Chris "Jethro" Schilling I JethroBT (WMF) <https://meta.wikimedia.org/wiki/User:I_JethroBT_(WMF)> He/His/Their Program Officer, Wikimedia Foundation <https://wikimediafoundation.org/wiki/Home> On Tue, Oct 23, 2018 at 8:08 PM Chris "Jethro" Schilling < cschilling(a)wikimedia.org> wrote: > Hi everyone, > > The open call for the Wikimedia Foundation Project Grants program will > begin on November 1, when we begin public review of new proposals. The > final deadline is November 30th for all submissions. < > https://meta.wikimedia.org/wiki/Grants:Project>. Importantly, this will > be the only open call for Project Grants in the current fiscal year, which > ends on June 30th 2019. > > We are also seeking additional volunteer candidates to expand the Project > Grants Committee. More information is provided at the end of this email. > > Project Grant funds are available to support individuals, groups and > organizations to implement new experiments and proven ideas, whether > focused on building a new tool or gadget, organizing a better process on > your wiki, researching an important issue, coordinating an editathon series > or providing other support for community building. > > We offer the following resources to help you plan your project and > complete a grant proposal: > * Tutorials for writing a strong application: < > https://meta.wikimedia.org/wiki/Grants:Project/Tutorial> > * General planning page for Project Grants: < > https://meta.wikimedia.org/wiki/Grants:Project/Plan> > * Program guidelines and criteria: < > https://meta.wikimedia.org/wiki/Grants:Project/Learn> > > Program officers are also available to offer individualized proposal > support upon request. Contact us at projectgrants(a)wikimedia.org if you > would like feedback or more information. > > We are excited to see your grant ideas that will support our community and > make an impact on the future of Wikimedia projects. Put your idea into > motion, and submit your proposal by November 30th! < > https://meta.wikimedia.org/wiki/Grants:Project/Apply> > > Volunteering for the Project Grants Committee > We are also seeking candidates to participate in the Project Grants > Committee, the volunteer decision-making body that reviews all Project > Grant proposals and decides which projects to fund. Committee members have > diverse backgrounds with skill sets like: > * On-wiki editing and experience > * Experience leading, coordinating, or managing projects with an intended > on-wiki or online impact. > * Background in handling externally provided money and working within > budgets, preferably in a non-profit context. > * Any grants you've applied for or worked in grant programs (in the > Wikimedia, academic, or wider non-profit world). > * Expertise in areas like knowledge equity or knowledge as a service, that > will help us move toward our movement strategic direction > * Software or research expertise > If you are interested in serving as a committee member, you cand find more > information and submit your candidacy here by November 15th: < > https://meta.wikimedia.org/wiki/Grants:Project/Committee/Candidates> > > Please feel free to get in touch with questions about getting started with > your grant application, or about serving on the Project Grants Committee. > Contact us at projectgrants(a)wikimedia.org. > > Take care, > > Chris > > Chris "Jethro" Schilling > I JethroBT (WMF) <https://meta.wikimedia.org/wiki/User:I_JethroBT_(WMF)> > He/His/Their > Program Officer, Wikimedia Foundation > <https://wikimediafoundation.org/wiki/Home> > _______________________________________________ Wikimedia-l mailing list, guidelines at: https://meta.wikimedia.org/wiki/Mailing_lists/Guidelines and https://meta.wikimedia.org/wiki/Wikimedia-l New messages to: Wikimedia-l(a)lists.wikimedia.org Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/wikimedia-l, <mailto:wikimedia-l-request@lists.wikimedia.org?subject=unsubscribe>

1 0

Looking for maintainers: RelatedSites
by Max Semenik 05 Nov '18

05 Nov '18

As RelatedSites extension has been undeployed from Wikimedia projects today[1], a question arises: who will maintain it in the future? Unless someone volunteers to maintain it, we will probably eventually have to archive the repository. According to WikiApiary[2], besides WMF it's used only on vojnaenciklopedija.com (ping Zoranzoki21). ---- [1] https://phabricator.wikimedia.org/T128326 [2] https://wikiapiary.com/wiki/Extension:RelatedSites -- Best regards, Max Semenik ([[User:MaxSem]])

2 2

Audiences Q1 FY1819 Quarterly Check-In slides & notes
by Megan Neisler 05 Nov '18

05 Nov '18

Hi, Wikitech-l Slide decks and notes from recent FY18/19 Q1 Audiences Quarterly Check-Ins are posted as follows: Audiences Session 1: Slides: https://commons.wikimedia.org/wiki/File:Audiences_Session_1_October_2018_Qu… Notes: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/Quarterly_… Audiences Session 2: Slides: https://commons.wikimedia.org/wiki/File:Audiences_Session_2_October_2018_Qu… Notes: https://meta.wikimedia.org/wiki/Wikimedia_Foundation_Annual_Plan/Quarterly_… These and other links are also posted on the quarterly check-in page. https://meta.wikimedia.org/w/index.php?title=Wikimedia_Foundation_Annual_Pl… Thanks, Megan -- Megan Neisler Senior Project Coordinator - Audiences & Technology Wikimedia Foundation

1 0

2018-10-31 Scrum of Scrums meeting notes
by Grace Gellerman 05 Nov '18

05 Nov '18

https://www.mediawiki.org/wiki/Scrum_of_scrums/2018-10-31 =2018-10-31= == Callouts == * Fundraising campaigns https://meta.wikimedia.org/wiki/CentralNotice/Calendar * Release Engineering: train blocked on T208398 Fatal error on testwiki on viewing talk pages when blocked and logged in * Community Tech: The 2019 community wishlist survey has begun! Please submit proposals and participate in the discussions! https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2019 == Audiences == === Contributors === ==== Community Tech ==== * Blocked by: * Blocking: * Updates: ** The 2019 community wishlist survey has begun! https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2019 ==== Anti-Harassment Tools ==== * Blocked by: * Blocking: * Updates: ** Partial Blocks code is out and rode the train; We're going to enable the interface on test wiki today or tomorrow. ==== Editing ==== * Blocked by: * Blocking: ** Updates: ** ==== Growth ==== * Blocked by: * Blocking: * Updates: ** ==== Language ==== * Blocked by: * Blocking: * Updates: ** Continue working on ContentTranslation version 2 improvments. In details: https://www.mediawiki.org/wiki/Content_translation/V2#October_2018 === Readers === ==== iOS native app ==== * Blocked by: * Blocking: * Updates: **6.1.0 in review, will be released after it's approved **6.1.0 won't allow editing wikidata descriptions of English articles - it will be enabled in the next release once English Wikipedia editors are notified (task: https://phabricator.wikimedia.org/T208252) **6.1.1 will be a bug-fix release (release board: https://phabricator.wikimedia.org/tag/ios-app-v6.1.1-narwhal-on-a-magic-pum…) ==== Android native app ==== * Blocked by: * Blocking: * Updates: **Released all the things to production (new navigation design, Echo notifications, etc.) ** https://phabricator.wikimedia.org/diffusion/APAW/history/master/;r/2.7.263-… ==== Readers Web ==== * Blocked by: * Blocking: * Updates: **At Wikimedia Technical Conference and team offsite ==== Readers Infrastructure ==== * Blocked by: n/a * Blocking: n/a * Updates: ** MCS/PCS: *** Working on fixing performance problems caused by CPU-bound work ( https://phabricator.wikimedia.org/T202642 ) *** PCS mobile-html: working on a strategy for handling i18n in shared mobile page content composed on the server ( https://phabricator.wikimedia.org/T205550 ) ** Maps: *** Fixing tilerator crash caused when attempting to access data subject to a lock in Postgres (https://phabricator.wikimedia.org/T204047 ) *** The Stretch upgrade/data loading on the maps cluster continues ( https://phabricator.wikimedia.org/T205462 ) ** Admin: *** New (properly registered) team IRC channel: #wikimedia-infrastructure ==== Multimedia ==== * Updates ** Matthias's baby has arrived, so we're pretty short-staffed atm ** hiring continues ** SDoC: First prototype enabled on beta, being tested ** SDoC: Working on UI/copy feedback, virtual statements, 'depicts' in UW, metrics ==== Parsing ==== * Blocked by: * Blocking: * Updates: ==== UI Standardization ==== * Blocked by: * Blocking: * Updates: ** == Technology == === Analytics === * Blocked by: * Blocking: * Updates: ** Druid cluster upgrade, now Turnilo supports monthly granularity visualizations ** Fixed vulnerabilities of all our node projects ** Productionized automatic ingestion of NavigationTiming, ReadingDepth and PageIssues EL schemas into Druid/Turnilo ** As part of migration from stat1005 to stat1007, moved users and home folders, stat1005 is not to be used any more! ** Working on deprecating the reportcard in favor of Wikistats2 === Cloud Services === * Blocked by: * Blocking: * Updates: ** === Fundraising Tech === * Blocked by: * Blocking: * Updates: ** CiviCRM: follow-on work to distinguish endowment donations ** CiviCRM: expanding donor data export / deletion extension ** CentralNotice backend maintenance work ** Dealing with PayPal's poorly timed recurring payment ID migration === MediaWiki Core Platform === * Blocked by: * Blocking: * Updates: ** === Performance === * Blocked by: ** * Blocking: ** * Updates: ** === Release Engineering === * Blocked by: ** train blocked on T208398 Fatal error on testwiki on viewing talk pages when blocked and logged in ** For fundraising, we need to upgrade composer merge plugin for Donation interface and mediawiki/vendor@fundraising/RE1_27 https://phabricator.wikimedia.org/T203084 *** Need a sync up with Antoine "hashar" Musso next week. * Blocking: ** Train Health: *** Last week: 1.33.0-wmf.1 deployment blockers https://phabricator.wikimedia.org/T206655 **** Six blockers closed, one opened on friday after conclusion of the train **** Group1 was delayed until Thursday and Group2 finally happened late Thursday evening. **** Otherwise it was a mostly uneventful train. The blockers were perhaps more worrisome than destructive, no outages occurred. *** This week: 1.33.0-wmf.2 deployment blockers https://phabricator.wikimedia.org/T206656 **** T208398 Fatal error on testwiki on viewing talk pages when blocked and logged in === Research === * Blocked by: None * Blocking: None * Updates: ** Writing papers for the Web Conference ** Working on the 3-5 year plan ** Starting a new online experiement for the "Elicit new editor interest" research project: https://meta.wikimedia.org/wiki/Research:Voice_and_exit_in_a_voluntary_work… === Scoring Platform === * Blocked by: DBAs: Need that DDL reviewed: https://phabricator.wikimedia.org/diffusion/EJAD/browse/master/sql/ * Blocking: None (hopefully) * Updates: ** Logstash fixes going live today ** Upgrade to celery 4 will gets deployed today ** upgrading flask to 0.12.4 will go live soon === Search Platform === * Blocked by: * Blocking: * Updates: ** === Security === * Blocked by: None * Blocking: T207798Security review for GrowthExperiments extension * Updates:T207798Security review for GrowthExperiments extension is in progress ** === Services === * Blocked by: * Blocking: * Updates: ** === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** Auditing all varnish fronted services for lack of TLS by SRE traffic team, you could be pinged. == Wikidata == * Blocked by: * Blocking: * Updates: ** == German Technical Wishlist == * Blocked by: * Blocking: * Updates: ** == Multi-Content Revisions == * Blocked by: * Blocking: * Updates: ** == SoS Meeting Bookkeeping == * Updates: **

1 0

Discovery Weekly Update for the week starting 2018-10-22
by Chris Koerner 05 Nov '18

05 Nov '18

This is the weekly update from the Search Platform team for the week starting 2018-10-22. As always, feedback and questions welcome. == Discussions == === Search === * Mathew and Gehel worked on refactoring the WDQS updater while also increasing the restart interval of the WDQS updater [0] [1] *There were some known issues that the Search team helped in fixing where the Elasticsearch puppet config changes broke puppet in various instances [2] *Erik fixed an issue where the sister search / cross language search interaction with multi-datacenter was a bit off [3] *The team worked on getting Debian Stretch off of Ubuntu Trusty for all instances of the search project [4], as well as various other updates needed to get ElasticSearch ready for version 6: as well as investigating just how many number of servers we really need in the ElasticSearch cluster. [5] [6] [7] [8] [9] *Gehel and Mathew also worked on |modifing scap::target to define sudo rules for multiple services [10] *Erik |fixed a failure where cirrusSearchIncomingLinkCount was getting a 'read timeout is reached' issue from title::getFirstRevision [11] *Erik finished up work to add autocomplete evaluation via MRR to relforge [12] == Other Noteworthy Stuff == * Oct 18-21 Trey went to WikiConferenceNA 2018. [13] Some highlights: ** He was interviewed [14] for the Wikijabber podcast. [15] ** He gave a lightning talk on homoglyphs. Slides are available online. [16] ** You can see the full conference schedule online [17] and find the slides for many of the presentations on Commons. [18] ** More detailed write up on MediaWiki. [19] == Did you know? == * Homoglyphs [20] are characters in different writing systems that look very similar or, in some fonts, even identical to each other. For example A/Α/А or M/Μ/М in Latin, Greek, and Cyrillic, respectively. Homoglyphs can be very hard to detect when reading, but they interfere with search because “Мoscow” and “Moscow” are completely different words from the point of view of search. The former starts with a Cyrillic M (as does Moscow’s name in Russian, “Москва”). There are often a few dozen examples of the mixed-script “Мoscow” [21] on English Wikipedia at any given time. (Trey cleans them up from time to time as a hobby, and hopes to create a plugin for Elasticsearch to automatically make them visible to search.) [0] https://phabricator.wikimedia.org/T208392 [1] https://phabricator.wikimedia.org/T207843 [2] https://phabricator.wikimedia.org/T205672 [3] https://phabricator.wikimedia.org/T205558 [4] https://phabricator.wikimedia.org/T204686 [5] https://phabricator.wikimedia.org/T206468 [6] https://phabricator.wikimedia.org/T206469 [7] https://phabricator.wikimedia.org/T206472 [8] https://phabricator.wikimedia.org/T206470 [9] https://phabricator.wikimedia.org/T207724 [10] https://phabricator.wikimedia.org/T206314 [11] https://phabricator.wikimedia.org/T206042 [12] https://phabricator.wikimedia.org/T205494 [13] https://wikiconference.org/wiki/2018/Main_Page [14] https://wikijabber.com/wikijab015-trey-jones/ [15] https://wikijabber.com/ [16] https://docs.google.com/presentation/d/1nQQUJ8W4NK4vf7WbKFp2YZz3Bvej97zRFO4… [17] https://wikiconference.org/wiki/2018/Schedule [18] https://commons.wikimedia.org/wiki/Category:WikiConference_North_America_20… [19] https://www.mediawiki.org/wiki/User:TJones_(WMF)/Notes/WikiConference_North… [20] https://en.wikipedia.org/wiki/Homoglyph [21] https://en.wikipedia.org/w/index.php?search=%D0%9Coscow&title=Special%3ASea… ---- Subscribe to receive on-wiki (or opt-in email) notifications of the Discovery weekly update. https://www.mediawiki.org/wiki/Newsletter:Discovery_Weekly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Discovery/Status_updates Interested in getting involved? See tasks marked as "Easy" or "Volunteer needed" in Phabricator. [1] https://phabricator.wikimedia.org/maniphest/query/qW51XhCCd8.7/#R [2] https://phabricator.wikimedia.org/maniphest/query/5KEPuEJh9TPS/#R Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation

1 0

Readers Monthly update for October 2018
by Chris Koerner 05 Nov '18

05 Nov '18

Hello, This is the monthly update from the Readers team at the Wikimedia Foundation for October 2018. Feedback and questions are encouraged. ==Discussions== === Apps === * iOS released version 6.1 to the App Store [0], which includes the ability to edit Wikidata sourced descriptions via the app interface, similar to the existing feature on the Android app. This feature is not enabled for English articles due to local community override described on-wiki. [1] === Web === * Wrapping up feedback on navigation prototype [2] ** English Wikipedia Signpost gave some love for our work for mobile contribution tools [3] === Reading Infrastructure === ==== MCS/PCS ==== *Working on fixing performance problems caused by CPU-bound work [4] *PCS mobile-html: working on a strategy for handling i18n in shared mobile page content composed on the server [5] ==== Maps ==== *Fixing Tilerator crash caused when attempting to access data subject to a lock in Postgres [6] *The Stretch upgrade/data loading on the maps cluster continues [7] === New Readers === * New Reader updates can be found at Meta. [8] === Multimedia === * The Structured Data on Commons project shared a prototype of a potential new search interface for content on Commons [9] ** You can keep up-to-date on their work on Commons [10] [0] https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=32471523… [1] https://en.wikipedia.org/wiki/Wikipedia:Short_description [2] https://www.mediawiki.org/wiki/Reading/Web/Advanced_mobile_contributions/Na… [3] https://en.wikipedia.org/wiki/Wikipedia:Wikipedia_Signpost/2018-10-01/Techn… [4] https://phabricator.wikimedia.org/T202642 [5] https://phabricator.wikimedia.org/T205550 [6] https://phabricator.wikimedia.org/T204047 [7] https://phabricator.wikimedia.org/T205462 [8] https://meta.wikimedia.org/wiki/New_Readers/Updates [9] https://commons.wikimedia.org/wiki/Commons:Structured_data/Get_involved/Fee… [10] https://commons.wikimedia.org/wiki/Commons:Structured_data/Get_involved#Kee… --- Subscribe to receive theses updates as on-wiki notifications or opt-in email. https://www.mediawiki.org/wiki/Newsletter:Readers_Monthly The archive of all past updates can be found on MediaWiki.org: https://www.mediawiki.org/wiki/Reading/Status_updates Yours, Chris Koerner Community Relations Specialist Wikimedia Foundation

1 0

quarry.wmflabs.org downtime starting in about an hour
by Andrew Bogott 05 Nov '18

05 Nov '18

We'll be shuffling the VMs that host the Quarry service over to a new corner of the cloud today. During the move the service will be unavailable and/or behave erratically. I don't expect the move to take more than an hour. I'll send a further notice when things are done. -Andrew + the WMCS team

1 1

Advice on Tuning Search?
by Hogan (US), Michael C 02 Nov '18

02 Nov '18

Can anyone point me to a starting point for learning about how to tune CirrusSearch (or examples)? I found the CirrusSearchScoreBuilder page [1], which implies it is possible to modify how search results are ranked. But, the documentation page hasn't been created yet. Thank you! [1]: https://www.mediawiki.org/wiki/Manual:Hooks/CirrusSearchScoreBuilder

5 4

TechCom Radar 2018-10-31
by Daniel Kinzler 02 Nov '18

02 Nov '18

Hello all, Here are the minutes from this week's TechCom meeting: * Following up on the Technical Conference in Portland (aka TechConf aka WMTC18). Some outcomes: -- We discussed the idea of sharding the revision table, with the big question being what key to shard on. Options include page ID and timestamp. Tim wants to look into this next fiscal. -- People were generally happy with the proposed Architecture Principles. Daniel put some of the feedback we got on the talk page, for discussion: <https://www.mediawiki.org/wiki/Talk:Wikimedia_Technical_Committee/MediaWiki…> -- More results of WMTC to follow over the next few weeks. * TechCom is moving to alternating times for their meetings. The public RFC discussions will alternate between the old time (Wednesday 2pm PST, 23:00 CET) and a new time (Wednesday 11pm PST, Thursday 08:00 CET). Times were chosen to allow people from the US, Europe and Australia to participate. Times may shift again as we get feedback on the new arrangement. * On Friday or Monday we’ll have PHP 7 working on the debug servers. Still figuring out how to select using the browser extension. (Giuseppe) * RFC accepted after last call: Spec for representing multiple content objects per revision (MCR) in XML dumps <https://phabricator.wikimedia.org/T199121>. During the last call, an issue with the representation of content hashes was addressed. For the new XML schema, see <https://www.mediawiki.org/wiki/Requests_for_comment/Schema_update_for_multi…>. Ariel and Daniel to follow up. * RFC accepted after last call: Release notes automation <https://phabricator.wikimedia.org/T200392>. Kunal to follow up. * No public RFC discussion next week. * Upcoming RFC discussion (probably on November 14): Session storage service interface <https://phabricator.wikimedia.org/T206010>. * Upcoming RFC discussion (probably on November 21): Introduce a new namespace for collaborative judgments about wiki entities (JADE) <https://phabricator.wikimedia.org/T200297>. You can also find our meeting minutes at <https://www.mediawiki.org/wiki/Wikimedia_Technical_Committee/Minutes> See also the TechCom RFC board <https://phabricator.wikimedia.org/tag/mediawiki-rfcs/>. If you prefer you can subscribe to our newsletter here: <https://www.mediawiki.org/wiki/Newsletter:TechCom_Radar> -- daniel

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l November 2018