Wikitech-l January 2021

wikitech-l@lists.wikimedia.org

35 participants
40 discussions

[REMINDER] Call for projects and mentors for Google Summer of Code 2021 and Outreachy Round 22 is ongoing!
by Pavithra Eswaramoorthy 26 Jan '21

26 Jan '21

Hello everyone, TLDR; Wikimedia will soon be applying as a mentoring organization to Google Summer of Code 2021 <https://summerofcode.withgoogle.com> [1] and Outreachy Round 22 <https://www.outreachy.org/> [2]. The application submission deadline for GSoC is February 20th, and Outreachy is March 7th. We are currently working on a list of interesting project ideas to include in the application. If you have some ideas for coding or non-coding (design, documentation, translation, outreach, research) projects, share them here: https://phabricator.wikimedia.org/T270429 [3]. Timeline As a mentor, you will be engaging potential candidates in the application period for GSoC between March 10th – April 13th, and for Outreachy between March 15th – April 16th. During this time, you will help candidates make small contributions to your project and answer any project related queries. You will be working more closely with the accepted candidates during the coding period between May-August. Project ideas We have started compiling a list of projects that you can take a look at here: https://www.mediawiki.org/wiki/Google_Summer_of_Code/2021 [4], https://www.mediawiki.org/wiki/Outreachy/Round_22 [5] If you don’t have an idea in mind and would like to pick one from an existing list, check out these projects: https://phabricator.wikimedia.org/tag/outreach-programs-projects/ [6] Through GSoC, you can mentor only coding but with Outreachy also non-coding projects (including design, documentation, translation, outreach, etc.). Note that GSoC has some changes this year, including: * Smaller project size ~175 hr project (previously 350 hr) * Shortened coding period T ~10 weeks long (previously 3 months) * Eligibility criteria redefined; the program is now open to candidates participating in a variety of academic programs (previously accredited university programs only) Please keep these changes in mind while sharing your project ideas. Some tips for proposing projects: * Follow this task description template when you propose a project in Phabricator: https://phabricator.wikimedia.org/tag/outreach-programs-projects [6]. Add #Google- Summer-of-Code (2021) or #Outreachy (Round 22) tag to it. * Remember, the project should require an experienced developer ~15 days to complete and a newcomer ~3 months for Outreachy and ~10 weeks for GSoC. * Each project should have at least 2 mentors, and one of them should hold a technical background. * When it comes to picking a project, you could propose one that is: * Relevant for your language community or brings impact to the Wikimedia ecosystem in the future. * Welcoming and newcomer-friendly and has a moderate learning curve. * A new idea you are passionate about, there are no deadlines attached to it; you always wanted to see it happen but couldn't due to lack of resources! * About developing a standalone tool (possibly hosted on Wikimedia Toolforge), with fewer dependencies on Wikimedia's core infrastructure, and doesn't necessarily require a specific programming language, etc. To learn more about the roles and responsibilities of a mentor, visit our resources on MediaWiki.org: https://www.mediawiki.org/wiki/Outreachy/Mentors [7], https://www.mediawiki.org/wiki/Google_Summer_of_Code/Mentors [8]. Cheers, GSoC 2021 and Outreachy Round 22 Administrators [1] https://summerofcode.withgoogle.com [2] https://www.outreachy.org/ [3] https://phabricator.wikimedia.org/T270429 [4] https://www.mediawiki.org/wiki/Google_Summer_of_Code/2021 [5] https://www.mediawiki.org/wiki/Outreachy/Round_22 [6] https://phabricator.wikimedia.org/tag/outreach-programs-projects/ [7] https://www.mediawiki.org/wiki/Outreachy/Mentors [8] https://www.mediawiki.org/wiki/Google_Summer_of_Code/Mentors

1 0

[Train] 1.36.0-wmf.27 status update (blocked at group0 by T272508)
by Brennen Bearnes 20 Jan '21

20 Jan '21

The 1.36.0-wmf.27 version of MediaWiki[0] is at group0[1], and is currently blocked. Thanks to James Forrester, RhinosF1, abi_, Nikerabbit, Urbanecm, Daimona, Ladsgroup, Marostegui, and probably others I'm forgetting for getting us this far. The new version cannot be deployed further until this issue is resolved: * PropertyInfoSnakUrlExpander: Bad value for parameter $snak->getDataValue(): must be a DataValues\StringValue - https://phabricator.wikimedia.org/T272508 Thanks for any help resolving this issue. If a fix is merged with reasonable time to deploy before the 15:00 Pacific deployment cutoff, the train will continue to group1 today.[2] Otherwise it will resume in the European morning window at earliest. -- Your temporary train tender [0]. <https://phabricator.wikimedia.org/T271341> [1]. <https://tools.wmflabs.org/versions/> [2]. https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#What_happ…

1 0

2021-01-20 Scrum of Scrums meeting notes
by Grace Gellerman 20 Jan '21

20 Jan '21

https://www.mediawiki.org/wiki/Scrum_of_scrums/2021-01-20 2021-01-20 == Callouts == * Seats still available for the frontend web performance training. Doodle seems to be favoring West coast times currently: https://doodle.com/poll/ax9qak5mwb7rzvuh?utm_source=poll&utm_medium=link === No updates === Community Tech === No notes provided ===Product Infrastructure, Parsing, Inuka, Analytics, Cloud Services, Fundraising Tech, Quality and Test, Security == SoS Meeting Bookkeeping == * Updates: 9 responses to async retro. Will release responses today. == Product == === Anti-Harassment Tools === * Blocked by: * Blocking: * Updates: ** Working with DBAs to add a new table in SecurePoll extension: https://phabricator.wikimedia.org/T271268 === Editing === * Blocked by: * Blocking: * Updates: Parser cache thing from last week not done; doing this week. === Growth === * Blocked by: * Blocking: * Updates: ** working on link recommendations - https://wikitech.wikimedia.org/wiki/Add_Link ** planning image recommendations together with a number of other teams === iOS native app === * Blocked by: N/A * Blocking: N/A * Updates: No major updates. Refining what is going to hit 6.8. === Android native app === * Blocked by: N/A * Blocking: N/A * Updates: No major updates. Starting to refine image tagging structured editing task. === Web === * Blocked by: * Blocking: * Updates: ** https://phabricator.wikimedia.org/T260091: Rolling out max-width in VectorV2 to more places via configurable allow/deny lists === Structured Data === * Blocked by: * Blocking: * Updates: ** Resuming work on splitting MediaSearch UI out into a separate extension === Abstract Wikipedia === * Blocked by: * Blocking: * Updates: ** Working to implement a look-ahead search widget in our Vue code; with thanks again to Anne and Eric for their support and insight from their MediaSearch experience. ** Making initial commits to stand up the evaluator and orchestrator services' bases. ** Still working on programmatic type management. ** Community contest to select the logo concept for Wikifunctions is currently running; ideas welcome! === Language === * Blocked by: None * Blocking: None * Updates: No major updates ** Train blocker fixed: https://phabricator.wikimedia.org/T272428 === Library === * Blocked by: * Blocking: * Updates: ** Investigating behavior tracking software options. Will probably install Matomo in staging in the next few weeks ** Wikilink bug fixes ** Working on the Wikipedia Library Echo notification === Vue.js === * Blocked by: * Blocking: * Updates: ** We exist now! Hello world! ** "We" are Roan (full-time), Volker, Anne T and Eric G, Marcella (part-time) ** More to come later as we figure out priorities == Technology == === Platform === * Blocked by: We are blocked on deploying LVS changes due to https://phabricator.wikimedia.org/T272258 (Traffic, DCOps) * Blocking: * Updates: None === Engineering Productivity === ==== Performance ==== * Blocked by: Data Persistence with setup of x2 cluster * Blocking: none * Updates: ==== Release Engineering ==== * Blocked by: ** * Blocking: ** * Updates: ** [All] Deployments/Covid-19 https://wikitech.wikimedia.org/wiki/Deployments/Covid-19 ** Train Health *** Last week: 1.36.0-wmf.26 [[phab:T267419]]  *** This week: 1.36.0-wmf.27 [[phab:T271341]]  *** Next week: 1.36.0-wmf.28 [[phab:T271342]]  === Search Platform === * Blocked by: ** no one * Blocking ** no one * Updates: ** Show correct create page/page exists message on wikis with multiple writing systems -https://phabricator.wikimedia.org/T260957 ** Reduce the impact of the sanitizer on wikidata - https://phabricator.wikimedia.org/T239931 ** "ElasticSearch shard size check" icinga warnings on cloudelastic servers -https://phabricator.wikimedia.org/T265908 ** Support cloudelastic in spicerack elasticsearch - https://phabricator.wikimedia.org/T268779 ** 40-elasticsearch-readahead udev rule failing for cloudelastic100[5,6] - https://phabricator.wikimedia.org/T265699 ** Restart elasticsearch clusters to apply readahead changes - https://phabricator.wikimedia.org/T266492 === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** Growth on setting up LVS for linkrecommendation. * Updates: ** No updates == Cross-cutting == * Blocked by: * Blocking: * Updates: ** PHP 8.0 compatibility for REL1_35 of MediaWiki core is relatively close. (T266583) Once that's done, we'll work to enable it as voting for (at least) all tarball extensions and then announce functional compatibility in 1.35.2 or whatever release. ** PHP 8.0 compatibility for master/production looks like it is stalled on the replacement for ElasticSearch(!) as PHP 8.0 support may be held back until the new non-OSI licence is in place (T271777, T272111). [[Category:Scrum of scrums{{#translation:}}|*]]

1 0

[Train] 1.36.0-wmf.27 status update (rolled back from group0, blocked by T272428)
by Brennen Bearnes 19 Jan '21

19 Jan '21

The 1.36.0-wmf.27 version of MediaWiki[0] has been rolled back from group0[1], and is currently blocked. The new version cannot be deployed until this issue is resolved: * Error 1146: Table 'mediawikiwiki.translate_cache' doesn't exist - https://phabricator.wikimedia.org/T272428 Thanks for any help resolving this issue. Since we're near the 3pm Pacific cutoff point for the day, at earliest, the train can roll forward in the European morning.[2] -- Your loquacious locomotive laggard [0]. <https://phabricator.wikimedia.org/T271341> [1]. <https://tools.wmflabs.org/versions/> [2]. https://wikitech.wikimedia.org/wiki/Deployments/Holding_the_train#What_happ…

1 0

SWT South Asia 2021
by Krishna Chaitanya Velaga 19 Jan '21

19 Jan '21

Hello everyone, Hope you are all doing well, and keeping safe. I am happy to share with you all an update about the Small wiki toolkits <https://meta.wikimedia.org/wiki/Small_wiki_toolkits> initiative in India, and the larger South Asian region. As part of the Small wiki toolkits initiative, in the second half of 2020, Indic-TechCom, in collaboration with WMF's Developer Advocacy team, designed and conducted a technical workshop series: "Small wiki toolkits - Indic workshop series 2020.” A report of the same can be seen at https://w.wiki/Yqf. There has been positive response from community members, as the workshops have been helpful in understanding basic to intermediate level technical processes on wikis. Two more workshops have been conducted towards the end of last year. So, we are now planning to continue to run these workshops (one per month on average) and expand them to the Wikimedia communities in the South Asian region. The objective is to impart basic to intermediate level technical skills for volunteers working on Wikimedia projects of languages in the South Asian region. More information can be found at https://meta.wikimedia.org/wiki/SWT_South_Asia/Overview The first session will be a brainstorming session on technical challenges faced by contributions on their wikis, from 6 pm to 7:30 pm (IST) on 24 January 2021. It will be facilitated by Birgit Müller (Director of Technical Engagement at WMF). If you are interested, please register at https://meta.wikimedia.org/wiki/SWT_South_Asia/Registration. This discussion will be crucial to decide topics for future workshops. Community members are also welcome to suggest topics for future workshops anytime at https://w.wiki/t8Q. These workshops are being organized with the help of a handful of volunteers from India, Nepal and Bangladesh, and if anyone is interested to help in organizing, please let us know. Regards, Krishna Chaitanya on behalf of SWT South Asia organizers <https://meta.wikimedia.org/wiki/SWT_South_Asia/Organization>

1 0

GSoC 2021
by Ayush Kumar 16 Jan '21

16 Jan '21

Hello Everyone, I’m Ayush Kumar pursuing my Bachelor's degree in Computer Science and Engineering from JSSATE Noida, India. I am very enthusiastic to explore open source and I am trying to connect with open source organizations to learn new skills and contribute to organizations. I am currently working as a web developer and want to contribute to your organization. I'd be grateful if someone could guide me on how I can get started with contributing to your organization. I am also preparing for GSoC2021.

2 1

Installer override help
by Michael Suddes 14 Jan '21

14 Jan '21

Tl;dr I’m looking for guidance on installer overrides and how to add to the web installer interface. Mainly to add SMW and other extensions to the end of LocalSettings.php automatically. ———- Greetings. I manage a small semantic mediawiki. I have been told that other facilities similar to mine would find it useful. To facilitate this, I have created an Amazon machine image of the full installed wiki with SMW, Visual Editor, and such. Along with the SMW data structures and queries in place. Originally, I was going to include instructions on changing the LocalSettings.php file manually, but ideally, I would like to modify the installer to include the needed config info for SMW and the other added extensions. Most of it will be straight appending of text to the end of LocalSettings.php, but the SecureHTML extension requires a bit of input that I would like to add to the web installer. I noted the installer override README, and I know it should work for my needs, but I have a few questions: •What installer step is ideal to trigger the override if I want to add text to the end of the file? •Can I use an installer override to add a field to the web installer? •I haven’t found much on Google about this, other than one project on GitHub, so any advice on a tutorial or notes would be greatly appreciated. Thanks! Michael

2 1

Test runner Quibble 0.0.46 released
by Antoine Musso 14 Jan '21

14 Jan '21

Hello, I am pleased to announce the release of Quibble 0.0.46 mainly driven by Adam Wight && Kosta Harlan. The major feature is support for using an external web server such as Apache. The php builtin server driven by Quibble serves requests serially and does not offer all the customization Apache can do. The source repository has an example Dockerfile that leverage the use of supervisord to spawn Apache and point Quibble to it. We will roll that system to the CI jobs progressively over the next few weeks. The journey started when Kosta benchmarked php vs Apache and by serving requests in parallel we have already addressed issues found in MediaWiki test suites. Python 3.8 is officially supported, 3.4 or earlier are no more tested and if still using those you should really upgrade. Running under podman (a daemonless alternative to docker) is now recognized as a container environment (thanks Marius Hoch). Doc: https://doc.wikimedia.org/quibble/ Changelog: https://doc.wikimedia.org/quibble/changelog.html Source: https://gerrit.wikimedia.org/g/integration/quibble/ Bug/features: #quibble tag in Phabricator Quibble introduction: https://phabricator.wikimedia.org/J99 cheers, -- Antoine "hashar" Musso

3 2

Releasing a small tool to explore wikipedia users contributions
by Shrinivasan T 14 Jan '21

14 Jan '21

Last week, we had a Indic Wikisource Proofreadthon 2020 event. see here for full details https://meta.wikimedia.org/wiki/Indic_Wikisource_Proofreadthon_2020 Though I did not participate in this event, (feels sad for this. Life is too messy nowadays), I thought to build a small tool to give report on any wikipedia user’s contribution on a given wikisite for a given date range. It may help to calculate, measure, decide on the contributions for such competitions. Mediawiki has a good API to fetch user contributions. https://www.mediawiki.org/wiki/API:Usercontribs Get all edits by a user. https://www.mediawiki.org/wiki/Special:MyLanguage/API:Usercontribs For my wonder, there was a sample python code on the same page. The code gave only 500 results. I wrote a loop to get the data batch by batch till all the data is received. Published the tool here – https://github.com/tshrinivasan/wiki_user_contributions_report How to run? python3 get_user_contributions.py <language> <wikisite> <username> <start_date> <end_date> This will give the data as a CSV file. Used a csv-to-html converter utility to convert this to a web page with all the data in a sortable table. For my wonder, my friend Dinesh Karthik, converted this as a nice web application with flask, dash and hosted in heroku. https://wiki-user-contributions.herokuapp.com/ Source : https://github.com/Dineshkarthik/wiki-user-contributions Thanks to Info-farmer for providing the idea, Bartosz Dziewoński on wikipedia mailing list for answering all my questions, Dinesh for making a web application quickly. https://lists.wikimedia.org/mailman/listinfo/wikitech-l is a good place to ask any tech questions regarding wikipedia. Thanks to all wikisource contributors for the event and in general. -- Regards, T.Shrinivasan My Life with GNU/Linux : http://goinggnu.wordpress.com Free E-Magazine on Free Open Source Software in Tamil : http://kaniyam.com Get Free Tamil Ebooks for Android, iOS, Kindle, Computer : http://FreeTamilEbooks.com

4 4

2021-01-13 Scrum of Scrums meeting notes
by Grace Gellerman 13 Jan '21

13 Jan '21

https://www.mediawiki.org/wiki/Scrum_of_scrums/2021-01-13 = 2021-01-13 = == Callouts == * https://phabricator.wikimedia.org/T264218: UX tweaks for VectorV2 at a screen width of 500px. This is on the 1.36.0-wmf.27 branch No updates: Parsing, Platform, Performance, SRE No notes provided: Prod Infra, Language, Inuka, Library, Analytics, Cloud Services, Fundraising Tech, Quality and Test, Search Platform, Security, == SoS Meeting Bookkeeping == * Updates: asynchronous retrospective ends today == Product == === Community Tech === * Blocked by: * Blocking: * Updates: - Getting ready to start consultation work around OCR tools improvement project - Still working on Wikisource/WS-export performance/reliability/UX === Anti-Harassment Tools === * Blocked by: ** Awaiting DBA comments on a new table in SecurePoll extension: https://phabricator.wikimedia.org/T271268 * Blocking: * Updates: === Editing === * Blocked by: * Blocking: * Updates: - FAO core platform: We are moving [ reply ] links on talk pages to the ParserCache this week, splitting the cache on talk pages by user preference: https://phabricator.wikimedia.org/T267404 === Growth === * Blocked by: * Blocking: * Updates: ** working on link recommendations === iOS native app === * Blocked by: None * Blocking: None * Updates: Development continues on next version === Android native app === * Blocked by: None * Blocking: None * Updates: Development continues on next version === Web === * Blocked by: * Blocking: * Updates: ** Awaiting the Security Readiness Review for WVUI from Security ** https://phabricator.wikimedia.org/T264218: UX tweaks for VectorV2 at a screen width of 500px. This is on the 1.36.0-wmf.27 branch === Structured Data === * Blocked by: * Blocking: * Updates: ** More MediaSearch feature development ** Starting to use results of image quality testing tool to tune MediaSearch search profile (https://phabricator.wikimedia.org/T269852) ** Working with Platform Engineering on proof of concept for image recommendations === Abstract Wikipedia === * Blocked by: * Blocking: * Updates: ** Making improvements to our Vue code; with thanks to Roan, Anne, and Eric ** Still working on programmatic type management. ** Process for a community contest to select the logo concept for Wikifunctions will start shortly. === Parsing === * Blocked by: None * Blocking: None * Updates: Nothing significant. == Technology == === Platform === * Blocked by: None * Blocking: * Updates: None === Engineering Productivity === ==== Performance ==== * Blocked by: * Blocking: * Updates: Routine, nothing new for anyone. ==== Release Engineering ==== * Blocked by: ** No blockers * Blocking: ** ??? * Updates: ** [All] Deployments/Covid-19 https://wikitech.wikimedia.org/wiki/Deployments/Covid-19 ** Train Health *** Last week: 1.36.0-wmf.25 [[phab:T267418]]  *** This week: 1.36.0-wmf.26 [[phab:T267419]]  *** Next week: 1.36.0-wmf.27 [[phab:T267419]]  === Site Reliability Engineering === * Blocked by: ** None * Blocking: ** None * Updates: ** No updates. == Cross-cutting == * Blocked by: * Blocking: * Updates: ** PHP 8.0 compatibility is now waiting on upstream elastica library compatibility before we can move forward with MediaWiki core, let alone production extensions. (This will likely require the completion of the ElasticSearch 6 -> 7 migration.) [[Category:Scrum of scrums{{#translation:}}|*]]

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

Wikitech-l January 2021