I will be upgrading the cloud-vps openstack install on Monday afternoon
my time (beginning around 18:00 UTC). Here's what to expect:
- Intermittent Horizon and API downtime (maybe an hour or two total)
- Inability to schedule new VMs (also for an hour or two)
- Some mild Horizon dashboard changes as I'll also be upgrading the
dashboards to version 'Zen'.
Toolforge users will be unaffected by this outage. Existing, running
services and VMs on cloud-vps should also be unaffected.
-Andrew + the WMCS team
Hello cloud-vps users!
It's time for our annual cleanup of unused projects and resources. Every
year or so the Cloud Services team tries to identify and clean up unused
projects and VMs. We do this via an opt-in process: anyone can mark a
project as 'in use,' and that project will be preserved for another year.
I've created a wiki page that lists all existing projects, here:
https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge
If you are a VPS user, please visit that page and mark any projects that
you use as {{Used}}. Note that it's not necessary for you to be a
project admin to mark something -- if you know that you're currently
using a resource and want to keep using it, go ahead and mark it
accordingly. If you /are/ a project admin, please take a moment to mark
which VMs are or aren't used in your projects.
When February arrives, I will shut down and begin the process of
reclaiming resources from unused projects.
If you think you use a VPS project but aren't sure which, I encourage
you to poke around on https://tools.wmflabs.org/openstack-browser/ to
see what looks familiar. Worst case, just email
cloud(a)lists.wikimedia.org with a description of your use case and we'll
sort it out there.
Exclusive toolforge users are free to ignore this email.
Thank you!
-Andrew and the WMCS team
Due to Foundation holidays + personal time off, WMCS staff will be hard
to reach during the end of December and beginning of January.
We /may/ be reachable during serious outages or emergencies, but I
recommend a light touch on any existing, working projects. For those of
you who also have time off, I hope you have an enjoyable break be it at
the keyboard or away from it.
-Andrew + WMCS staff
While troubleshooting an infrastructure issue I just now accidentally
triggered a reboot of a few VMs, including the primary host of toolsdb.
If you see a little storm of alert in your tool logs about timeouts and
disconnections, that was what that was.
Everything should be back to normal now!
-Andrew