As part of routine networking and OS upgrades, I'll be emptying two hypervisors (cloudvirt1016 and cloudvirt1017) on Monday and Tuesday, the 22nd and 23rd. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows.
I'll begin by moving the deployment-prep project at around 13:00 UTC on Monday. After that copies will proceed in roughly the order you see below, but the timing will be hard to predict.
Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time!
-Andrew + the WMCS team
Affected instances (shown as <project>: <instance name>):
account-creation-assistance: accounts-appserver4 account-creation-assistance: accounts-mwoauth automation-framework: af-puppetdb02 butterfly: butterfly-m4m2 cloudinfra: cloudinfra-db02 codereview: Krypton codereview: Radon commtech: commtech-2 community-labs-monitoring: clm-web-01 community-labs-monitoring: clm-worker-01 dashiki: dashiki-01 dashiki: dashiki-staging-01 deployment-prep: deployment-cache-text05 deployment-prep: deployment-changeprop deployment-prep: deployment-chromium01 deployment-prep: deployment-chromium02 deployment-prep: deployment-cpjobqueue deployment-prep: deployment-dumps-puppetmaster02 deployment-prep: deployment-elastic06 deployment-prep: deployment-elastic07 deployment-prep: deployment-etcd-01 deployment-prep: deployment-eventlog05 deployment-prep: deployment-imagescaler01 deployment-prep: deployment-imagescaler02 deployment-prep: deployment-ircd deployment-prep: deployment-jobrunner03 deployment-prep: deployment-kafka-jumbo-1 deployment-prep: deployment-logstash2 deployment-prep: deployment-mediawiki-07 deployment-prep: deployment-memc06 deployment-prep: deployment-memc07 deployment-prep: deployment-mwmaint01 deployment-prep: deployment-ores01 deployment-prep: deployment-puppetdb02 deployment-prep: deployment-puppetmaster03 deployment-prep: deployment-restbase01 deployment-prep: deployment-restbase02 deployment-prep: deployment-sentry01 deployment-prep: deployment-snapshot01 deployment-prep: deployment-urldownloader02 deployment-prep: deployment-zookeeper02 design: design-research-methods dumps: dumps-0 dwl: dwl dwl: taxonbota fa-wp: tofawiki02 getstarted: gitservices getstarted: webservices glampipe: Glampipe hound: hound-puppet-02 integration: integration-cumin integration: integration-r-lang-01 integration: integration-slave-docker-1040 integration: integration-slave-docker-1041 integration: integration-slave-jessie-1002 k8splay: k8s-dzahn lizenzhinweisgenerator: lizenzhinweisgenerator maps: maps-tiles1 maps: maps-warper3 openrefine: openrefine01 openstack: cloud-bootstrapvz-stretch otrs: otrs-oneclickspam-test packagist-mirror: packagist-mirror1 partnermetrics: partnermetrics-redis-01 puppet-diffs: compiler1001 qna: meza-new2 quotatest: novaadminmadethis6 reading-web-staging: readers-web-master recommendation-api: missing-sections recommendation-api: rec-wiki recommendation-api: related-articles recommendation-api: tool security-tools: logparse01 sentry: frama-test5 sentry: frama-test6-sb services: kask services: kask-client shinken: shinken-02 shiny-r: discovery-production-02 testlabs: abogott-puppetmaster testlabs: canary1016-01 tools: tools-sgecron-01 tools: tools-sgegrid-shadow toolsbeta: toolsbeta-sgecron-01 toolsbeta: toolsbeta-sgegrid-shadow toolsbeta: toolsbeta-sgewebgrid-lighttpd-0901 twl: wmil video: encoding01 video: gfg01 video: video-redis video: videodev videowiki: app-instance visualeditor: dumpgrepper webperf: disposable wikidata-dev: wikidata-constraints wikidata-federation: federated-commons wikidata-federation: federated-wikidata wikidiff2-wmde-dev: wmde-wikidiff2-jacnth wikidocumentaries: hupu wikidocumentaries: roope wikidumpparse: whgi wikifactmine: elasticsearch-20 wikifactmine: elasticsearch-21 wikifactmine: puppetmaster-01 wikilabels: wikilabels-02 wikilabels: wikilabels-experiment wikimetrics: wikimetrics-01 wikistream: ws-web wikitextexp: wikitextexp-base-1002 wikitextexp: wikitextexp-expt-1002 wm-bot: wm-bot-pg wm-bot: wm-bot2 wmf-research-tools: diegoTest wmf-research-tools: wikilabels wpx: wpx-redirects-01
_______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-announce@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Apologies! This is happening in July rather than August -- about 12 days from now.
On 7/10/19 2:24 PM, Andrew Bogott wrote:
As part of routine networking and OS upgrades, I'll be emptying two hypervisors (cloudvirt1016 and cloudvirt1017) on Monday and Tuesday, the 22nd and 23rd. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows.
I'll begin by moving the deployment-prep project at around 13:00 UTC on Monday. After that copies will proceed in roughly the order you see below, but the timing will be hard to predict.
Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time!
-Andrew + the WMCS team
Affected instances (shown as <project>: <instance name>):
account-creation-assistance: accounts-appserver4 account-creation-assistance: accounts-mwoauth automation-framework: af-puppetdb02 butterfly: butterfly-m4m2 cloudinfra: cloudinfra-db02 codereview: Krypton codereview: Radon commtech: commtech-2 community-labs-monitoring: clm-web-01 community-labs-monitoring: clm-worker-01 dashiki: dashiki-01 dashiki: dashiki-staging-01 deployment-prep: deployment-cache-text05 deployment-prep: deployment-changeprop deployment-prep: deployment-chromium01 deployment-prep: deployment-chromium02 deployment-prep: deployment-cpjobqueue deployment-prep: deployment-dumps-puppetmaster02 deployment-prep: deployment-elastic06 deployment-prep: deployment-elastic07 deployment-prep: deployment-etcd-01 deployment-prep: deployment-eventlog05 deployment-prep: deployment-imagescaler01 deployment-prep: deployment-imagescaler02 deployment-prep: deployment-ircd deployment-prep: deployment-jobrunner03 deployment-prep: deployment-kafka-jumbo-1 deployment-prep: deployment-logstash2 deployment-prep: deployment-mediawiki-07 deployment-prep: deployment-memc06 deployment-prep: deployment-memc07 deployment-prep: deployment-mwmaint01 deployment-prep: deployment-ores01 deployment-prep: deployment-puppetdb02 deployment-prep: deployment-puppetmaster03 deployment-prep: deployment-restbase01 deployment-prep: deployment-restbase02 deployment-prep: deployment-sentry01 deployment-prep: deployment-snapshot01 deployment-prep: deployment-urldownloader02 deployment-prep: deployment-zookeeper02 design: design-research-methods dumps: dumps-0 dwl: dwl dwl: taxonbota fa-wp: tofawiki02 getstarted: gitservices getstarted: webservices glampipe: Glampipe hound: hound-puppet-02 integration: integration-cumin integration: integration-r-lang-01 integration: integration-slave-docker-1040 integration: integration-slave-docker-1041 integration: integration-slave-jessie-1002 k8splay: k8s-dzahn lizenzhinweisgenerator: lizenzhinweisgenerator maps: maps-tiles1 maps: maps-warper3 openrefine: openrefine01 openstack: cloud-bootstrapvz-stretch otrs: otrs-oneclickspam-test packagist-mirror: packagist-mirror1 partnermetrics: partnermetrics-redis-01 puppet-diffs: compiler1001 qna: meza-new2 quotatest: novaadminmadethis6 reading-web-staging: readers-web-master recommendation-api: missing-sections recommendation-api: rec-wiki recommendation-api: related-articles recommendation-api: tool security-tools: logparse01 sentry: frama-test5 sentry: frama-test6-sb services: kask services: kask-client shinken: shinken-02 shiny-r: discovery-production-02 testlabs: abogott-puppetmaster testlabs: canary1016-01 tools: tools-sgecron-01 tools: tools-sgegrid-shadow toolsbeta: toolsbeta-sgecron-01 toolsbeta: toolsbeta-sgegrid-shadow toolsbeta: toolsbeta-sgewebgrid-lighttpd-0901 twl: wmil video: encoding01 video: gfg01 video: video-redis video: videodev videowiki: app-instance visualeditor: dumpgrepper webperf: disposable wikidata-dev: wikidata-constraints wikidata-federation: federated-commons wikidata-federation: federated-wikidata wikidiff2-wmde-dev: wmde-wikidiff2-jacnth wikidocumentaries: hupu wikidocumentaries: roope wikidumpparse: whgi wikifactmine: elasticsearch-20 wikifactmine: elasticsearch-21 wikifactmine: puppetmaster-01 wikilabels: wikilabels-02 wikilabels: wikilabels-experiment wikimetrics: wikimetrics-01 wikistream: ws-web wikitextexp: wikitextexp-base-1002 wikitextexp: wikitextexp-expt-1002 wm-bot: wm-bot-pg wm-bot: wm-bot2 wmf-research-tools: diegoTest wmf-research-tools: wikilabels wpx: wpx-redirects-01
_______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-announce@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Reminder: This is happening today, starting right now.
-Andrew
On 7/10/19 2:24 PM, Andrew Bogott wrote:
As part of routine networking and OS upgrades, I'll be emptying two hypervisors (cloudvirt1016 and cloudvirt1017) on Monday and Tuesday, the 22nd and 23rd. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows.
I'll begin by moving the deployment-prep project at around 13:00 UTC on Monday. After that copies will proceed in roughly the order you see below, but the timing will be hard to predict.
Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time!
-Andrew + the WMCS team
Affected instances (shown as <project>: <instance name>):
account-creation-assistance: accounts-appserver4 account-creation-assistance: accounts-mwoauth automation-framework: af-puppetdb02 butterfly: butterfly-m4m2 cloudinfra: cloudinfra-db02 codereview: Krypton codereview: Radon commtech: commtech-2 community-labs-monitoring: clm-web-01 community-labs-monitoring: clm-worker-01 dashiki: dashiki-01 dashiki: dashiki-staging-01 deployment-prep: deployment-cache-text05 deployment-prep: deployment-changeprop deployment-prep: deployment-chromium01 deployment-prep: deployment-chromium02 deployment-prep: deployment-cpjobqueue deployment-prep: deployment-dumps-puppetmaster02 deployment-prep: deployment-elastic06 deployment-prep: deployment-elastic07 deployment-prep: deployment-etcd-01 deployment-prep: deployment-eventlog05 deployment-prep: deployment-imagescaler01 deployment-prep: deployment-imagescaler02 deployment-prep: deployment-ircd deployment-prep: deployment-jobrunner03 deployment-prep: deployment-kafka-jumbo-1 deployment-prep: deployment-logstash2 deployment-prep: deployment-mediawiki-07 deployment-prep: deployment-memc06 deployment-prep: deployment-memc07 deployment-prep: deployment-mwmaint01 deployment-prep: deployment-ores01 deployment-prep: deployment-puppetdb02 deployment-prep: deployment-puppetmaster03 deployment-prep: deployment-restbase01 deployment-prep: deployment-restbase02 deployment-prep: deployment-sentry01 deployment-prep: deployment-snapshot01 deployment-prep: deployment-urldownloader02 deployment-prep: deployment-zookeeper02 design: design-research-methods dumps: dumps-0 dwl: dwl dwl: taxonbota fa-wp: tofawiki02 getstarted: gitservices getstarted: webservices glampipe: Glampipe hound: hound-puppet-02 integration: integration-cumin integration: integration-r-lang-01 integration: integration-slave-docker-1040 integration: integration-slave-docker-1041 integration: integration-slave-jessie-1002 k8splay: k8s-dzahn lizenzhinweisgenerator: lizenzhinweisgenerator maps: maps-tiles1 maps: maps-warper3 openrefine: openrefine01 openstack: cloud-bootstrapvz-stretch otrs: otrs-oneclickspam-test packagist-mirror: packagist-mirror1 partnermetrics: partnermetrics-redis-01 puppet-diffs: compiler1001 qna: meza-new2 quotatest: novaadminmadethis6 reading-web-staging: readers-web-master recommendation-api: missing-sections recommendation-api: rec-wiki recommendation-api: related-articles recommendation-api: tool security-tools: logparse01 sentry: frama-test5 sentry: frama-test6-sb services: kask services: kask-client shinken: shinken-02 shiny-r: discovery-production-02 testlabs: abogott-puppetmaster testlabs: canary1016-01 tools: tools-sgecron-01 tools: tools-sgegrid-shadow toolsbeta: toolsbeta-sgecron-01 toolsbeta: toolsbeta-sgegrid-shadow toolsbeta: toolsbeta-sgewebgrid-lighttpd-0901 twl: wmil video: encoding01 video: gfg01 video: video-redis video: videodev videowiki: app-instance visualeditor: dumpgrepper webperf: disposable wikidata-dev: wikidata-constraints wikidata-federation: federated-commons wikidata-federation: federated-wikidata wikidiff2-wmde-dev: wmde-wikidiff2-jacnth wikidocumentaries: hupu wikidocumentaries: roope wikidumpparse: whgi wikifactmine: elasticsearch-20 wikifactmine: elasticsearch-21 wikifactmine: puppetmaster-01 wikilabels: wikilabels-02 wikilabels: wikilabels-experiment wikimetrics: wikimetrics-01 wikistream: ws-web wikitextexp: wikitextexp-base-1002 wikitextexp: wikitextexp-expt-1002 wm-bot: wm-bot-pg wm-bot: wm-bot2 wmf-research-tools: diegoTest wmf-research-tools: wikilabels wpx: wpx-redirects-01
_______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-announce@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce
Thanks to 10GbE, this went quite a bit faster than I expected and is now done. I've confirmed that all affected VMs are up and reachable, but please let me know if you encounter any unexpected problems from the move.
-Andrew
On 7/22/19 8:30 AM, Andrew Bogott wrote:
Reminder: This is happening today, starting right now.
-Andrew
On 7/10/19 2:24 PM, Andrew Bogott wrote:
As part of routine networking and OS upgrades, I'll be emptying two hypervisors (cloudvirt1016 and cloudvirt1017) on Monday and Tuesday, the 22nd and 23rd. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows.
I'll begin by moving the deployment-prep project at around 13:00 UTC on Monday. After that copies will proceed in roughly the order you see below, but the timing will be hard to predict.
Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time!
-Andrew + the WMCS team
Affected instances (shown as <project>: <instance name>):
account-creation-assistance: accounts-appserver4 account-creation-assistance: accounts-mwoauth automation-framework: af-puppetdb02 butterfly: butterfly-m4m2 cloudinfra: cloudinfra-db02 codereview: Krypton codereview: Radon commtech: commtech-2 community-labs-monitoring: clm-web-01 community-labs-monitoring: clm-worker-01 dashiki: dashiki-01 dashiki: dashiki-staging-01 deployment-prep: deployment-cache-text05 deployment-prep: deployment-changeprop deployment-prep: deployment-chromium01 deployment-prep: deployment-chromium02 deployment-prep: deployment-cpjobqueue deployment-prep: deployment-dumps-puppetmaster02 deployment-prep: deployment-elastic06 deployment-prep: deployment-elastic07 deployment-prep: deployment-etcd-01 deployment-prep: deployment-eventlog05 deployment-prep: deployment-imagescaler01 deployment-prep: deployment-imagescaler02 deployment-prep: deployment-ircd deployment-prep: deployment-jobrunner03 deployment-prep: deployment-kafka-jumbo-1 deployment-prep: deployment-logstash2 deployment-prep: deployment-mediawiki-07 deployment-prep: deployment-memc06 deployment-prep: deployment-memc07 deployment-prep: deployment-mwmaint01 deployment-prep: deployment-ores01 deployment-prep: deployment-puppetdb02 deployment-prep: deployment-puppetmaster03 deployment-prep: deployment-restbase01 deployment-prep: deployment-restbase02 deployment-prep: deployment-sentry01 deployment-prep: deployment-snapshot01 deployment-prep: deployment-urldownloader02 deployment-prep: deployment-zookeeper02 design: design-research-methods dumps: dumps-0 dwl: dwl dwl: taxonbota fa-wp: tofawiki02 getstarted: gitservices getstarted: webservices glampipe: Glampipe hound: hound-puppet-02 integration: integration-cumin integration: integration-r-lang-01 integration: integration-slave-docker-1040 integration: integration-slave-docker-1041 integration: integration-slave-jessie-1002 k8splay: k8s-dzahn lizenzhinweisgenerator: lizenzhinweisgenerator maps: maps-tiles1 maps: maps-warper3 openrefine: openrefine01 openstack: cloud-bootstrapvz-stretch otrs: otrs-oneclickspam-test packagist-mirror: packagist-mirror1 partnermetrics: partnermetrics-redis-01 puppet-diffs: compiler1001 qna: meza-new2 quotatest: novaadminmadethis6 reading-web-staging: readers-web-master recommendation-api: missing-sections recommendation-api: rec-wiki recommendation-api: related-articles recommendation-api: tool security-tools: logparse01 sentry: frama-test5 sentry: frama-test6-sb services: kask services: kask-client shinken: shinken-02 shiny-r: discovery-production-02 testlabs: abogott-puppetmaster testlabs: canary1016-01 tools: tools-sgecron-01 tools: tools-sgegrid-shadow toolsbeta: toolsbeta-sgecron-01 toolsbeta: toolsbeta-sgegrid-shadow toolsbeta: toolsbeta-sgewebgrid-lighttpd-0901 twl: wmil video: encoding01 video: gfg01 video: video-redis video: videodev videowiki: app-instance visualeditor: dumpgrepper webperf: disposable wikidata-dev: wikidata-constraints wikidata-federation: federated-commons wikidata-federation: federated-wikidata wikidiff2-wmde-dev: wmde-wikidiff2-jacnth wikidocumentaries: hupu wikidocumentaries: roope wikidumpparse: whgi wikifactmine: elasticsearch-20 wikifactmine: elasticsearch-21 wikifactmine: puppetmaster-01 wikilabels: wikilabels-02 wikilabels: wikilabels-experiment wikimetrics: wikimetrics-01 wikistream: ws-web wikitextexp: wikitextexp-base-1002 wikitextexp: wikitextexp-expt-1002 wm-bot: wm-bot-pg wm-bot: wm-bot2 wmf-research-tools: diegoTest wmf-research-tools: wikilabels wpx: wpx-redirects-01
_______________________________________________ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-announce@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud-announce