Routine network upgrades are scheduled for Thursday which may result in
brief WMCS service interruptions. In particular, Wikitech and Horizon
may stop working, and instance creation/deletion/updating may briefly fail.
The network engineers have reserved a two-hour window beginning at 16:00
UTC (9 AM Pacific time). Their worst case scenario is 30 minutes of
downtime but if all goes well the interruption should not be noticeable,
just the time to unplug a cable from one switch and plug it into another.
Hi!
We would like to share some information regarding Wikimedia Cloud
Services plans for deprecating Ubuntu, specially Trusty.
Ubuntu Trusty's end-of-life is April 2019 and the WMF decided to
consolidate in a single operating system, which is Debian.
In Cloud VPS, projects containing Ubuntu virtual machine instances have
been contacted by means of a Phabricator task. Toolforge users aren't
affected by this right now, because Toolforge itself is currently
running Trusty. But we are already working on the next, Debian-based,
Toolforge version.
All this information, more details (and timelines), can be found on
this Wikitech page:
https://wikitech.wikimedia.org/wiki/News/Trusty_deprecation
Please, let us know any question or doubt you may have.
Best regards.
At 6pm UTC, Thursday 2018-09-27, we’ll be taking the primary tools/project NFS system offline for a brief moment to attempt some upgrades, which should cause load to climb a bit and then settle. This should be a relatively low-impact change and has been thoroughly tested in a separate environment, but if anything goes wrong with the process, corrective action may cause a few minutes of problems.
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org
IRC: bstorm_
At 6pm UTC, we will be briefly resetting the main NFS server for tools and projects to upgrade the tooling around NFS there. This should cause a brief climb in processes waiting for IO and then that will settle out.
If things don’t operate as expected, rolling back the change could take a few minutes, but that seems unlikely. Please let us know if there are prolonged issues in the #wikipedia-cloud channel.
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org
IRC: bstorm_
There are currently 57 unclaimed projects on
https://wikitech.wikimedia.org/wiki/Cloud_VPS_2018_Purge. I will start
shutting down unclaimed projects at the beginning of next month, and
those projects will be left behind in the future network migration[1]
and, eventually, deleted.
If you see anything in this list that you care about, please indicate
that the project is in use on the Wikitech page. Here are the 57
projects that are currently unmarked:
aicaptcha
bots
bstorm-test
chicotestproject
ci-staging
collection-alt-renderer
contributors
deep-learning-services
discourse-wam
download
etytree
fastcci
glampipe
globaleducation
hat-imagescalers
hound
iiifls1
ircd
jupyter
maps
maps-team
matrix
mcr-dev
mediahandler-tests
mediawiki-docker
multimedia
mw-api-testing
mw-extension-ids
newsletter
nonfreewiki
openocr
orig
pagemigration
piwik
project-smtp
rdfiodev
reading-lists
redirects
reportcard
sentry
services
services-testbed
t136871
test-twemproxy
tor
traffic
wcdo
wdq-mm
wikibrain
wikidata-page-banner
wikidata-primary-sources-tool
wikidumpparse
wikifactmine
wikimetrics
wikisource-tools
wikistream
wlmjudging
[1]
https://phabricator.wikimedia.org/phame/post/view/112/neutron_is_finally_co…
All,
As you may have read about in other venues, the Wikimedia Foundation will
be conducting a switchover of datacenters on September 11 and 12, with the
switch back to occur on October 10 and 11. During the switchover and
switch-back events, the wikis will be in read-only mode.
Cloud VPS and Toolforge are not affected by these switchovers. However, if
you run bots or scripts that make edits to the wikis, they may be unable to
make edits during this time. This should appear to your bots as the
standard read-only mode which occurs unplanned on the production wikis from
time to time.
Please let me know if you have any questions.
----
James Hare
Associate Product Manager
Wikimedia Foundation
https://wikimediafoundation.org