The barrage of hardware failures continues! Next week the eqiad staff will be repairing cloudvirt1014; to prepare I'll be draining it on this Thursday (2020-02-20), beginning around 15:00 UTC. Affected instances will be down for a few minutes and then rebooted. Toolforge users should be largely unaffected by this maintenance.
Here is the list of affected VMs:
traffic-cache-atsupload-buster canary1014-01 util-abogott-buster filippo-log-buster01 staging opusmt mw01 grantreview-04 cloud-puppetmaster-03 commtech-wikiwho toolsbeta-test-k8s-haproxy-2 debmonitor-pm toolsbeta-test-k8s-control-1 toolsbeta-test-k8s-etcd-2 toolsbeta-test-k8s-etcd-1 jmm-debm-01 xtools-dev05 ores-web-05 roebling ores-web-04 cloudinfra-db02 Krypton discovery-production-02 maps-tiles1 wikitextexp-base-1002 accounts-appserver4 tofawiki02 packagist-mirror1 deployment-elastic06 deployment-changeprop deployment-restbase02 deployment-imagescaler01 deployment-kafka-jumbo-1 deployment-memc07 deployment-eventlog05 deployment-cpjobqueue deployment-mediawiki-07 deployment-chromium01 deployment-cache-text05 whgi wikilabels gitservices wikilabels-02 af-puppetdb02 missing-sections ores-lb-03 matrix-synapse-01 captcha-tf-43 k4-2
This is all done. Sorry for the interruption!
On 2/18/20 11:00 PM, Andrew Bogott wrote:
The barrage of hardware failures continues! Next week the eqiad staff will be repairing cloudvirt1014; to prepare I'll be draining it on this Thursday (2020-02-20), beginning around 15:00 UTC. Affected instances will be down for a few minutes and then rebooted. Toolforge users should be largely unaffected by this maintenance.
Here is the list of affected VMs:
traffic-cache-atsupload-buster canary1014-01 util-abogott-buster filippo-log-buster01 staging opusmt mw01 grantreview-04 cloud-puppetmaster-03 commtech-wikiwho toolsbeta-test-k8s-haproxy-2 debmonitor-pm toolsbeta-test-k8s-control-1 toolsbeta-test-k8s-etcd-2 toolsbeta-test-k8s-etcd-1 jmm-debm-01 xtools-dev05 ores-web-05 roebling ores-web-04 cloudinfra-db02 Krypton discovery-production-02 maps-tiles1 wikitextexp-base-1002 accounts-appserver4 tofawiki02 packagist-mirror1 deployment-elastic06 deployment-changeprop deployment-restbase02 deployment-imagescaler01 deployment-kafka-jumbo-1 deployment-memc07 deployment-eventlog05 deployment-cpjobqueue deployment-mediawiki-07 deployment-chromium01 deployment-cache-text05 whgi wikilabels gitservices wikilabels-02 af-puppetdb02 missing-sections ores-lb-03 matrix-synapse-01 captcha-tf-43 k4-2
cloud-announce@lists.wikimedia.org