Hello!
Much of the Cloud Services staff will be traveling and attending
meetings next week. There will always be someone available for
emergencies, but routine support requests may get handled more slowly
than usual.
Things will be back to normal the following Monday, the 25th.
- Andrew + the Cloud Services team
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 3-4 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting: https://www.mediawiki.org/wiki
/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
Because the NFS for tools is getting very tight, I am going to clean up (truncate) log, err and out files that are greater than 100M.
On Monday (6/11/2018) I will be starting this cleanup process.
If you have concerns about this process, please let us know on #wikimedia-cloud .
Thank you for your understanding,
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org
IRC: bstorm_
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
As part of routine security maintenance, we'll be rebooting all VMs and
virtualization hosts next Wednesday starting at 14:00 UTC (7AM San
Francisco time).
Toolforge users should be largely unaffected by this activity. Other
projects (including deployment-prep) will experience sporadic downtime,
a few minutes for each interruption.
The entire process will take several hours. If you need a to-the-minute
advance schedule for any particular reboot, please let me know and I'll
put your system at the start.
-Andrew + the cloud team
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Hi!
We deleted the prometheus user from LDAP and created it locally [0].
This may cause puppet failures, since there is a timeframe in which the
id/gid in /var/lib/prometheus is the old LDAP one.
We are running a massive, CloudVPS-wide deluser/adduser/chown operation
to fix this.
[0] https://phabricator.wikimedia.org/T196137
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
ToolsDB will be undergoing maintenance and updates, Tuesday, June 5th at 1500 UTC to 1600 UTC.
Actual outage times should be fairly brief, but during this time the database will be taken offline and the system rebooted. Due to the expected brief nature of the outage and the fact that some tables are not replicated (see https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#ToolsDB_Backups… <https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#ToolsDB_Backups…>), we are not planning on failing over to the replica at this time.
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org
IRC: bstorm_
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Sorry for cross-posting!
Reminder: Technical Advice IRC meeting again **tomorrow, Wednesday 3-4 pm
UTC** on #wikimedia-tech.
The Technical Advice IRC meeting is open for all volunteer developers,
topics and questions. This can be anything from "how to get started" over
"who would be the best contact for X" to specific questions on your project.
If you know already what you would like to discuss or ask, please add your
topic to the next meeting: https://www.mediawiki.org/
wiki/Technical_Advice_IRC_Meeting
Hope to see you there!
Michi (for WMDE’s tech team)
--
Michael F. Schönitzer
Wikimedia Deutschland e.V. | Tempelhofer Ufer 23-24 | 10963 Berlin
Tel. (030) 219 158 26-0
http://wikimedia.de
Stellen Sie sich eine Welt vor, in der jeder Mensch an der Menge allen
Wissens frei teilhaben kann. Helfen Sie uns dabei!
http://spenden.wikimedia.de/
Wikimedia Deutschland - Gesellschaft zur Förderung Freien Wissens e.V.
Eingetragen im Vereinsregister des Amtsgerichts Berlin-Charlottenburg unter
der Nummer 23855 B. Als gemeinnützig anerkannt durch das Finanzamt für
Körperschaften I Berlin, Steuernummer 27/681/51985.
Dumps consumers:
Forwarding this note from the xmldatadumps-l(a)lists.wikimedia.org list
about an upcoming change to the number of files generated for some
wikis (for example dewiki's stub-articles dumps).
If you use dumps regularly in your tool, please do subscribe to the
xmldatadumps-l(a)lists.wikimedia.org list [0] for future notices like
this. The list is generally low volume and high signal with
announcements of process change as well as operational issues that may
slow dumps generation.
[0]: https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
Bryan
---------- Forwarded message ----------
From: Ariel Glenn WMF <ariel(a)wikimedia.org>
Date: Thu, May 31, 2018 at 5:36 AM
Subject: [Xmldatadumps-l] change to output file numbering of big wikis
To: Wikipedia Xmldatadumps-l <Xmldatadumps-l(a)lists.wikimedia.org>,
Wikimedia developers <wikitech-l(a)lists.wikimedia.org>
TL;DR:
Scripts that reply on xml files numbered 1 through 4 should be updated
to check for 1 through 6.
Explanation:
A number of wikis have stubs and page content files generated 4 parts
at a time, with the appropriate number added to the filename. I'm
going to be increasing that thi month to 6.
The reason for the increase is that near the end of the run there are
usually just a few big wikis taking their time at completing. If they
run with 6 processes at once, they'll finish up a bit sooner.
If you have scripts that rely on the number 4, just increase it to 6
and you're done.
This will go into effect for the June 1 run and all runs afterwards.
Thanks!
_______________________________________________
Xmldatadumps-l mailing list
Xmldatadumps-l(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/xmldatadumps-l
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Cloud Services Boise, ID USA
irc: bd808 v:415.839.6885 x6855
We upgraded the Mono/.NET framework in Toolforge/GridEngine from the 3.x
version to 5.x [0].
We discovered that some tweaking is required due to some weird behavior
regarding memory allocation by the framework [1].
The first symptom you will see is your boot doing high CPU load (spins).
The fix is easy, just telling Mono that more memory is available when
running the tool/bot. But you require to cancel your job submissions and
resend. Please refer to the phabricator bug [1] for more details.
Sorry for the inconvenience.
[0] https://phabricator.wikimedia.org/T194665
[1] https://phabricator.wikimedia.org/T195834
_______________________________________________
Wikimedia Cloud Services announce mailing list
Cloud-announce(a)lists.wikimedia.org (formerly labs-announce(a)lists.wikimedia.org)
https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Some subscribers to this list who also use MediaWiki APIs in their
tools may not know about the
mediawiki-api-announce(a)lists.wikimedia.org and
mediawiki-api(a)lists.wikimedia.org lists, so I am reposting this
announcement here. Please respond with any questions/concerns about
the API change on the mediawiki-api(a)lists.wikimedia.org rather than
this list.
Bryan
---------- Forwarded message ----------
From: Brad Jorsch (Anomie) <bjorsch(a)wikimedia.org>
Date: Wed, May 23, 2018 at 7:03 AM
Subject: [Mediawiki-api-announce] BREAKING CHANGE: Passing too many
values for a multi-valued parameter waring is becoming an error
To: mediawiki-api-announce(a)lists.wikimedia.org
The API has traditionally ignored values beyond the allowed limit,
returning a warning for this situation since 2008(!). It's long past
time for this error situation to actually raise an error, as requested
in https://phabricator.wikimedia.org/T41936.
This is happening in https://gerrit.wikimedia.org/r/433742. It should
be deployed to Wikimedia wikis with 1.32.0-wmf.6 or later, see
https://www.mediawiki.org/wiki/MediaWiki_1.32/Roadmap for the
schedule.
Logs indicate that few clients on Wikimedia wikis are hitting the
warning. You can check your client by seeing if you're receiving a
"Too many values supplied for parameter" warning, or by using
Special:ApiFeatureUsage for your client's user agent and looking for a
"too-many-X" code.
If your client is affected, the solution is to divide the values into
batches of the appropriate size. Generally the limit is 50 values for
clients without the apihighlimits right and 500 for clients with that
right. The limits for any particular parameter are documented in the
auto-generated help and are available in machine-readable format via
action=paraminfo.
--
Brad Jorsch (Anomie)
Senior Software Engineer
Wikimedia Foundation
_______________________________________________
Mediawiki-api-announce mailing list
Mediawiki-api-announce(a)lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce
--
Bryan Davis Wikimedia Foundation <bd808(a)wikimedia.org>
[[m:User:BDavis_(WMF)]] Manager, Cloud Services Boise, ID USA
irc: bd808 v:415.839.6885 x6855