We will be performing some updates (including reboots) on the tools NFS servers for Toolforge and CloudVPS instances that use project NFS (with the exception of dumps) at 1500 UTC on Wed Aug 29. The maintenance window will be two hours and more than one NFS server failover is expected during that time. This could cause some temporary impact to performance and load on the various connected servers during failovers.
Brooke Storm
Operations Engineer
Wikimedia Cloud Services
bstorm(a)wikimedia.org <mailto:bstorm@wikimedia.org>
IRC: bstorm_
In an attempt to identify abandoned VPS projects, I've created a wiki
page that lists all existing projects, here:
https://wikitech.wikimedia.org/wiki/Cloud_VPS_2018_Purge
Currently 85 projects[2] on that list are unclaimed. If you are a VPS
user, please visit that page and mark any projects that you use as
{{Used}}. Note that it's not necessary for you to be a project admin to
mark something -- if you know that you're currently using a resource and
want to keep using it, go ahead and mark it accordingly. If you /are/ a
project admin, please take a moment to mark which VMs are or aren't used
in your projects.
When October arrives, I will shut down and begin the process of
reclaiming unused projects.
If you think you use a VPS project but aren't sure which, I encourage
you to poke around on https://tools.wmflabs.org/openstack-browser/ to
see what looks familiar. You can also log in to
http://horizon.wikimedia.org which will provide you with a handy menu of
projects that you are currently a member of.
Thank you!
-Andrew and the WMCS team
[1]
https://phabricator.wikimedia.org/phame/post/view/112/neutron_is_finally_co…
[2] Here, for good measure, is that list. Every one of these projects
is currently a candidate for deletion:
aicaptcha
analytics
bots
chicotestproject
ci-staging
codereview
collection-alt-renderer
commonsarchive
community-labs-monitoring
contributors
dashiki
deep-learning-services
discourse
discourse-wam
download
etytree
fastcci
getstarted
glampipe
globaleducation
hat-imagescalers
hound
iiab
iiifls1
ircd
jupyter
kubernetes-testing
maps
maps-team
math
matrix
mcr-dev
mediahandler-tests
mediawiki-docker
multimedia
mw-api-testing
mw-extension-ids
mwfuzz
mwoffliner
newsletter
nonfreewiki
openocr
ores
orig
otrs
pagemigration
paws
phlogiston
piwik
project-smtp
rcm
rdfiodev
reading-lists
reading-web-staging
recommendation-api
redirects
reportcard
sciencesource
sentry
services
services-testbed
t136871
test-twemproxy
thumbor
tor
traffic
twl
utrs
video
wcdo
wdq-mm
wikibase-nearest-neighbors
wikibrain
wikidata-federation
wikidata-page-banner
wikidata-primary-sources-tool
wikidumpparse
wikifactmine
wikimetrics
wikisource-tools
wikistream
wikitolearn-dev
wildcat
wlmjudging
wmf-research-tools
We're drawing close to a painful migration event[1], during which we
will (probably) have to copy VMs between hosts one project at a time,
largely by hand. For that reason, I'm feeling even stingier than usual
about preserving unused and/or abandoned projects and instances.
It's been a couple of years since we last did this, and I'm sure there
are some newly forgotten projects in the cloud. So, I've created a wiki
page the lists all existing projects, here:
https://wikitech.wikimedia.org/wiki/Cloud_VPS_2018_Purge
If you are a VPS user, please visit that page and mark any projects that
you use as {{Used}}. Note that it's not necessary for you to be a
project admin to mark something -- if you know that you're currently
using a resource and want to keep using it, go ahead and mark it
accordingly. If you /are/ a project admin, please take a moment to mark
which VMs are or aren't used in your projects.
When October arrives, I will shut down and begin the process of
reclaiming unused projects.
If you think you use a VPS project but aren't sure which, I encourage
you to poke around on https://tools.wmflabs.org/openstack-browser/ to
see what looks familiar. Worst case, just email
cloud(a)lists.wikimedia.org with a description of your use case and we'll
sort it out there.
Exclusive toolforge users are free to ignore this task.
Thank you!
-Andrew and WMCS team
[1] The eqiad->eqiad1 migration, also known as the 'nova-network to
neutron' migration which I hope to write more about soon. It won't
happen by surprise, I promise.
Hi!
Next monday 13th we will be doing some maintenance on the main Cloud VPS
deployment to merge the keystone service of both main and eqiad1
deployments (the new one that we will eventually put into production).
Toolforge users will not be affected by this outage.
Day: Monday 13th August
Start time: 14:00 UTC
Finish time: 16:00 UTC or ASAP
Keystone is a central point in openstack, so most horizon operations
like login, creating/deleting VMs could be affected. On the other hand,
VMs will keep working and we don't expect any network outage.
This operation will allow us to have a smooth transition in the future
when we move all projects and instances to the new eqiad1 deployment and
is a previous step to having multi-region support in our Cloud VPS service.
Please let us know any question or suggestions you may have.
best regards.