Hi,
I got the email below telling me that my cron job running as
william-avery-bot had throw an error, and I noticed that the Grid job that
it kicks off hasn't run since.
I tried deleting the job using the instructions at
https://wikitech.wikimedia.org/wiki/Help:Toolforge/Grid#Stopping_jobs_with_…
but it appeared "stuck".
"qstat -xml" outputs the following:
<?xml version='1.0'?>
<job_info xmlns:xsd="
http://arc.liv.ac.uk/repos/darcs/sge/source/dist/util/resources/schemas/qst…
">
<queue_info>
<job_list state="running">
<JB_job_number>9999749</JB_job_number>
<JAT_prio>0.25319</JAT_prio>
<JB_name>cron-TaxonbarSyncerBot</JB_name>
<JB_owner>tools.william-avery-bot</JB_owner>
<state>dr</state>
<JAT_start_time>2021-03-25T17:49:16</JAT_start_time>
<queue_name>task(a)tools-sgeexec-0916.tools.eqiad.wmflabs</queue_name>
<slots>1</slots>
</job_list>
</queue_info>
<job_info>
</job_info>
</job_info>
But when I ssh to tools-sgeexec-0916.tools.eqiad.wmflabs I see no sign of
any processes under tools.william-avery-bot, except the ones associated
with my interactive session.
Can anyone help resolve this or advise of a venue to raise it?
Thanks in advance,
Will
---------- Forwarded message ---------
From: Cron Daemon <root(a)tools.wmflabs.org>
Date: Thu, 25 Mar 2021 at 16:49
Subject: Cron <tools.william-avery-bot@tools-sgecron-01> /usr/bin/jsub -N
cron-TaxonbarSyncerBot -once -quiet ~/TaxonbarSyncerBot.sh
To: <tools.william-avery-bot(a)tools.wmflabs.org>
error: commlib error: got select error (Connection refused)
error: unable to send message to qmaster using port 6444 on host
"tools-sgegrid-shadow.tools.eqiad1.wikimedia.cloud": got send error
Traceback (most recent call last):
File "/usr/bin/job", line 48, in <module>
root = xml.etree.ElementTree.fromstring(proc.stdout.read())
File "/usr/lib/python3.5/xml/etree/ElementTree.py", line 1345, in XML
return parser.close()
xml.etree.ElementTree.ParseError: no element found: line 1, column 0
Hello!
tl;dr: It's time for the annual Developer Satisfaction Survey! *This survey
is for everyone who uses any of the tools or services mentioned below*,
whether you would call yourself a "developer" or not. *Closing date is
March 24th.*
*The survey*: https://forms.gle/xj2jNUcP7kmSgtwV8
Longer:
The Wikimedia Foundation is soliciting your feedback to measure developer
satisfaction and determine where to invest resources in the future. This is
the third iteration of this survey. We want feedback from everyone who uses
any of the below tools or services, whether you call yourself a "developer"
or not.
Topics covered include:
* Local Development Environment
* Beta Cluster / Staging Environment
* Testing / CI
* Code Review
* Deployments
* Account Management and Onboarding
* Observability
* Phabricator
* Developer documentation
* General Feedback
We are soliciting feedback from all Wikimedia developers, including Staff,
3rd party contributors and volunteer developers. *The survey will be open
for a little over 2 weeks, closing on Wednesday March 24th.*
NOTE: This survey will be conducted via a third-party service, which may be
subject to additional terms. For more information on privacy and
data-handling, see the survey privacy statement
https://foundation.wikimedia.org/wiki/Developer_Satisfaction_Survey_Privacy…
*To participate in this survey, please start here:*
https://docs.google.com/forms/d/e/1FAIpQLSfJCzxixT1wHCIgI5PijIMQvcIqDbsDTYb…
Thank you for your participation,
Greg
--
| Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E |
| Dir. Engineering Productivity A18D 1138 8E47 FAC8 1C7D |
Hi everyone my name is Sulabh Bansal and I am a final year B.Tech computer
science and engineering student. My specialization lies in the field of
cloud and DevOps. And I am comfortable with Java, Html, CSS, Javascript,
Git, Github, Docker, Mysql as well as cloud platforms. I am also a Red Hat
Certified System administrator and ansible specialist. I would like to
contribute to Wikimedia Foundation and looking forward to GSoC 2021.
I would like to join this community and gain a better experience in terms
of learning and sharing.
Thank you.
This is a summary of this week's deployment of the 1.36.0-wmf.36
branch of MediaWiki and its extensions. The primary person in charge
this week is Antoine Musso, with Ahmon Dancy as backup, both from the
Release Engineering team.
The summary task for this week is
https://phabricator.wikimedia.org/T274940
This week's deployment was not successful. The train got to group 2,
but had to be rolled back all the way to group 0, which is where it is
at right now. The current problems are:
- T278478: FlaggedRevs: PHP Notice: Undefined index: status
https://phabricator.wikimedia.org/T278478
- T278429:
Translate\PageTranslation\ParserOutput::sourcePageTextForRendering()
must be an instance of Language, instance of StubUserLang given
https://phabricator.wikimedia.org/T278429
- T277795: User not found by actor ID: [id]
https://phabricator.wikimedia.org/T277795
The general policy is to NOT deploy on Fridays. If we deploy something
on a Friday and the sites break on Saturday, multiple people may need
to be alerted to diagnose and fix or work around the problem. Thus,
when fixes are found, we tend to deploy them on Monday instead. Then,
on Tuesday, the next train can start.
Issues that have already been dealt with along the week:
- T277722: TypeError: this._languageCodes is undefined at
getLanguageNameMap
https://phabricator.wikimedia.org/T277722
- T278375: Class 'GlobalUsageHooks' not found
https://phabricator.wikimedia.org/T278375
- T278379: Argument 1 passed to
ProofreadPage\Index\IndexTemplateStyles::__construct() must be an
instance of Title, null given, called in
/srv/mediawiki/php-1.36.0-wmf.36/extensions/ProofreadPage/includes/Page/PageContent.php
on line 284
https://phabricator.wikimedia.org/T278379
- T278400: PHP Warning: array_key_exists(): The first argument should
be either a string or an integer
https://phabricator.wikimedia.org/T278400
We saw some people highlight especially risky patches in the week's
summary task. That was very welcome! Thank you, Amir Sarabadani and
Roan Kattouw.
As usual, a whole bunch of people helped to find, triage, analyze,
fix, or work around problems this. Release Engineering thanks
everyone, without help we wouldn't be able to deploy MediaWiki.
- Abijeet Patro
- Adam_WMDE
- Amir Sarabadani
- Asartea
- Daniel Kinzler
- DannyS712
- James Forrester
- Johan Jönsson
- Jon Robson
- Klaas Skelte van der Werf
- Max Binder
- Niklas Laxström
- Pchelolo
- Roan Kattouw
- Silvan_WMDE
- Sohom Datta
- Timo Tijhof
- Tpt
- Urbanecm
There may have been other people, and if so, we apologize for not
including them on the list above.
For more information, please see:
- https://phabricator.wikimedia.org/T274940
- https://wikitech.wikimedia.org/wiki/Heterogeneous_deployment/Train_deploys
Hello all,
I am exploring pywikibot to write few bots.
When importing it as a library in my python code, on initial execution it
asks to login to the relevant wiki site.
Then it works as expected.
How long this login session is stored?
Is one time login enough?
Will it ask to login after some time?
How to run this in a daily cron job on any remote server, if the session
persistence is some limited time.
Share some thoughts on this.
Thanks.
Shrini
Hello,
The 1.36.0-wmf.36 version of MediaWiki is blocked. The few blockers from
Wednesday got addressed and we rolled to group 1 again. Today I have
deployed to group 2 and then finally rolled back BOTH group 1 and 2.
The new blockers:
* FlaggedRevs: PHP Notice: Undefined index: status
https://phabricator.wikimedia.org/T278478
Impact unknown to me. It might well cause user facing issue on enwiki.
That is worth rolling back group 2.
* Translate\PageTranslation\ParserOutput::sourcePageTextForRendering()
must be an instance of Language, instance of StubUserLang given
https://phabricator.wikimedia.org/T278429
Which I filed earlier today as part of log triage. We did not
immediately recognized it prevented edits on pages using Translate.
Notably on metawiki. That is worth rolling back group 1.
* User not found by actor ID: [id]
https://phabricator.wikimedia.org/T277795
Which is from last week. It still had at least one occurrence for the
brief time we had 1.36.0-wmf.36 on all wikis.
Once these issues are resolved the train can resume and we can try
pushing 1.36.0-wmf.36 to all wikis.
1.36.0-wmf.36 general task:
https://phabricator.wikimedia.org/T274940
Thank you for your assistance.
--
Antoine "hashar" Musso
Hello,
The 1.36.0-wmf.36 version of MediaWiki is blocked. Immediately after
pushing it to group 1 wikis, it encountered three blockers:
* Class 'GlobalUsageHooks' not found
https://phabricator.wikimedia.org/T278375
* Constructing RevisionRecord for a page that can't exist:
Special:MyLanguage/Main Page
[Called from MediaWiki\Revision\MutableRevisionRecord::__construct]
https://phabricator.wikimedia.org/T278376
* Argument 1 passed to
ProofreadPage\Index\IndexTemplateStyles::__construct() must be a Title,
null given.
https://phabricator.wikimedia.org/T278379
The later had the most log entries and apparently prevents page from
being submitted on wikisources wiki.
Once these issues are resolved the train can resume and we can try
pushing to group 1 wikis again.
1.36.0-wmf.36 general task:
https://phabricator.wikimedia.org/T274940
Thank you for your assistance.
--
Antoine "hashar" Musso
https://www.mediawiki.org/wiki/Scrum_of_scrums/2021-03-24
= 2021-03-24 =
(meeting conflict with Product Platform Strategy overview)
== Callouts ==
* RelEng: All extensions will have a buster variant of their main CI job
added as voting next week. This shouldn't break anything (it's been running
in production for months now), but be aware if your extension suddenly
stops passing tests. https://phabricator.wikimedia.org/T252432
* SRE Service Ops:
** Eqiad kubernetes cluster upgraded, reinitialized and fully repooled.
Some Job backlog was created, it's being served though.
** Many thanks to all the teams for having worked on
https://phabricator.wikimedia.org/T274262
* RelEng: Developer satisfaction survey extended until until 2021-03-31
* RelEng: When to use train vs backports quick guide:
https://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport
== Gerrit patches or GitHub Pull Requests for reviews or feedback ==
*
=== No updates ===
iOS
=== '''No notes provided''' ===
Editing, Parsing, Inuka, Cloud Services, Platform, Performance, Security,
== SoS Meeting Bookkeeping ==
* Updates:
== Product ==
=== Community Tech ===
* Blocked by:
* Blocking:
* Thank yous:
** Subbu and other parsoid team members for their help and support with
several tasks
* Updates:
** We'll be wrapping up WS-Export work this week and move on full-time onto
the OCR Improvements wish
https://meta.wikimedia.org/wiki/Community_Wishlist_Survey_2020/Wikisource/N…
=== Anti-Harassment Tools ===
* Blocked by:
* Blocking:
* Thank yous:
** Huge thanks to David Lynch for excellent work on SecurePoll, and helping
mentor our new engineers
** Thanks to everyone who has helped with onboarding the engineers
* Updates:
** No updates
=== Growth ===
* Blocked by:
* Blocking:
* Thank yous:
** SRE with their continued support with the link recommendation service
** Search for their help with indexing pages with recommendations
* Updates:
** Continuing work on Add Link https://wikitech.wikimedia.org/wiki/Add_Link
*** Available (in its current unfinished form) via Special:Homepage on
testwiki and beta cswiki now
** Continuing to work on on-wiki configuration
** Continuing design of mentor dashboard
https://www.mediawiki.org/wiki/Growth/Mentor_dashboard
** Deploying Growth features in opt-in mode this week to tewiki, jawiki,
eowiki, nbwiki, sqwiki, hiwiki
=== Android native app ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates: No big updates. Continuing our work w/ Platform Engineering Team
on image recommendations - we're getting near the MVP launch date and
cooperatively pruning the remaining desired API features.
=== Web ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** No updates. We're continuing our work on the language switcher
instrumentation and A/B test
=== Product Infrastructure ===
* Blocked by:
* Blocking:
* Thank yous: From SRE Serviceops for work on
https://phabricator.wikimedia.org/T274262
* Updates:
=== Structured Data ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** Wrapping up final work before MediaSearch goes default on Commons
** Continuing to work on improved search profile
** Continued discussions across teams regarding Structured Data Across
Wikimedia (image recommendations API and structured content)
=== Abstract Wikipedia ===
* Blocked by:
** None.
* Blocking:
** None.
* Thank yous:
** Scott B. from Security for running a great threat modelling exercise
with us.
* Updates:
** Closing on end of Phase γ:
https://meta.wikimedia.org/wiki/Abstract_Wikipedia/Phases
=== Language ===
* Blocked by: None.
* Blocking: None.
* Thank yous:
** Alexandros Kosiaris for cluster upgrades and for T278141 help.
* Updates:
** No major updates deployed in Section Translation this week.
** MassMessage remote wiki delivery was briefly broken. Now fixed.
** Working on new translation variable syntax for better Parsoid support.
** There is now a limit how big translatable pages can be moved. Working on
a script to move manually pages that are too big.
** Improving ULS language selector dialog positioning (for Web team).
** Translatable templates are usable on translatable pages with the normal
syntax for transclusion. (https://phabricator.wikimedia.org/T47096)
=== Library ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** Started work on making library partner's descriptions translatable
** Getting first mock-ups of the Library redesign. They look great and we
look forward to implementing them!
=== Vue.js ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** Onboarding our new program manager!
** Planning for the experimental shared internal component library, both on
the design front and the development side
== Technology ==
=== Analytics ===
* Blocked by:
* Blocking:
** SRE Service Ops on https://phabricator.wikimedia.org/T274262
* Thank yous:
* Updates:
** mw server replacements in codfw proceeding
** Eqiad kubernetes cluster upgraded, reinitialized and fully repooled.
Some Job backlog was created, it's being served though.
=== Fundraising Tech ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** More work on email prefs page https://phabricator.wikimedia.org/T268510
** Enhancements to optional employer autocomplete field (used for matching
gifts)
** CiviCRM contribution import enhancements
https://phabricator.wikimedia.org/T271416,
https://phabricator.wikimedia.org/T275445
** Investigating software libraries that handle multiple payment providers
https://phabricator.wikimedia.org/T277246,
https://phabricator.wikimedia.org/T277245
** Better error handling for CentralNotice invalid banner name:
https://phabricator.wikimedia.org/T173782
** Audit / reconciliation file processing improvements:
https://phabricator.wikimedia.org/T277244,
https://phabricator.wikimedia.org/T265545
=== Engineering Productivity ===
==== Quality and Test Engineering ====
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** "Outreachy, December 2020-March 2021" blog post by Željko Filipin
https://phabricator.wikimedia.org/phame/post/view/233/outreachy_december_20…
==== Release Engineering ====
* Blocked by:
* Blocking:
* Thank yous:
** Daniel Zahn on ServiceOps for Gerrit apache help!
* Updates:
** Deployments/Covid-19
https://wikitech.wikimedia.org/wiki/Deployments/Covid-19
** Train Health
*** Last week: 1.36.0-wmf.35 [[phab:T274939]] <!--
https://phabricator.wikimedia.org/T274939 -->
*** This week: 1.36.0-wmf.36 [[phab:T274940]] <!--
https://phabricator.wikimedia.org/T274940 -->
*** Next week: 1.36.0-wmf.37 [[phab:T278343]] <!--
https://phabricator.wikimedia.org/T278343 -->
** All extensions will have a buster variant of their main CI job added as
voting next week. This shouldn't break anything (it's been running in
production for months now), but be aware in case your extension suddenly
stops passing tests. https://phabricator.wikimedia.org/T252432
** (MediaWiki core, vendor, and skins all are already running the
buster-based PHP72 job as voting in CI.)
** Backport / config deploys vs. train patch guidance; see
https://wikitech.wikimedia.org/wiki/Deployments/Train_vs_backport
=== Search Platform ===
* Blocked by:
* Blocking:
* Thank yous:
* Updates:
** Fix Glent M2 CJK suggestion tokenization -
https://phabricator.wikimedia.org/T265081
** Add hasrecommendation: search keyword -
https://phabricator.wikimedia.org/T269493
** [Log noise] "Prefix search request was longer than the maximum allowed
length." - https://phabricator.wikimedia.org/T276385
** Create new elasticsearch cookbook that combines a plugin upgrade with a
full reboot - https://phabricator.wikimedia.org/T277792
** Update TextCat / Language ID documentation -
https://phabricator.wikimedia.org/T271249
** Unsustainable increases in Elasticsearch cluster disk IO -
https://phabricator.wikimedia.org/T264053
** selenium-daily-beta-CirrusSearch is failing -
https://phabricator.wikimedia.org/T276571
** Fix Flink Serialization Bug - https://phabricator.wikimedia.org/T276131
** Investigate Resource Needs for Commons and Wikidata Elasticsearch
indices - https://phabricator.wikimedia.org/T265914
** Uncaught Error: Widget not found / Call to a member function
getNsIndex() on null on CirrusSearch result page with internal error -
https://phabricator.wikimedia.org/T277332
=== Site Reliability Engineering ===
* Blocked by:
** Analytics on https://phabricator.wikimedia.org/T274262
* Blocking:
* Thank yous:
* Updates:
**
=== WMDE Technical Wishes ===
* Blocked by:
* Blocking:
* Thank yous: To WMF Analytics, especially MForns and AOtto for the code
review, feedback, and many deployments on our behalf.
* Updates:
** Currently working on the Kartographer map extension throughout
prototyping week, in order to enable it on dewiki we will need to fix a bug
with how map overlay content is linked to page revision.
** Two successful deployments today: enabling bracket matching for group0
wikis and wikitech, and an update to syntax highlighting colors everywhere.
== Cross-cutting ==
* Blocked by:
** [long term] Search Platform: PHP 8.0 work is long-term blocked on the
migration to ElasticSearch 7.0 https://phabricator.wikimedia.org/T263142
(or at least 6.7)
* Blocking:
** None?
* Thank yous:
** Daimona for their continued work on phan tooling.
** Antoine from RelEng for support on the stretch -> buster CI migration.
* Updates:
** PHP 8.0 work is focussed on helping upstream provide forwards and
backwards compatibility in Elastica-related PHP code; this is theoretically
the last upstream blocker to PHP 8.0.
** CI tools' upgrade status:
https://libraryupgrader2.wmcloud.org/status?branch=master
[[Category:Scrum of scrums{{#translation:}}|*]]
/ sorry for cross-posting
Hi,
On a few first wikis[1], you can now highlight pairs of brackets in
wikitext. For this to work, you need to turn on the syntax highlighting
feature, which is part of the 2010 and 2017 wikitext editors. By placing
your cursor next to or within a set of brackets, you can then match round,
square and curly brackets. For more information about this feature please
visit its project page.[2]
Deployment to other wikis is planned for later this year. If your wiki
community wants to get bracket matching now, please contact me.
This change has been implemented by the Technical Wishes team who is
currently working on several projects within the focus area "Make working
with templates easier"[3]. Other projects in this focus area, including
those for the Visual Editor, are in the making.
Many thanks to all who have contributed to the realization of this project
through comments, interviews and more. Feedback is, as always, welcome on
the project's talk page.[4]
Thanks,
Johanna for the Technical Wishes team
[1] dewiki, cawiki and trwiki
[2] https://meta.wikimedia.org/wiki/WMDE_Technical_Wishes/Bracket_Matching
[3] https://meta.wikimedia.org/wiki/WMDE_Technical_Wishes/Templates
[4]
https://meta.wikimedia.org/wiki/Talk:WMDE_Technical_Wishes/Bracket_Matching