These VMs have all finished copying. Please let me know if you see any ongoing problems that result from the move.
-Andrew
On 8/5/19 7:40 AM, Andrew Bogott wrote:
Reminder: This is happening today, starting in a few minutes.
-Andrew
On 7/31/19 9:26 AM, Andrew Bogott wrote:
In the interest of finishing up this stage of upgrades, I'm going to try to also drain cloudvirt1023 during the same window. That includes the following additional VMs:
services: appservice privpol-captcha: captcha-imageprocessing-11 privpol-captcha: captcha-tf-43 pluggableauth: cindy search: clickmodel codesearch: codesearch4 cvn: cvn-apache9 cvn: cvn-app8 cvn: cvn-app9 language: cxserver cyberbot: cyberbot-db-01 discourse: discourse-mw dumps: dumps-3 wikifactmine: elasticsearch-01 eventmetrics: eventmetrics-prod01 fastcci: fastcci-new-master catgraph: fishbone huggle: huggle-deb-builder analytics: k4-1 analytics: k4-2 puppet: keith-puppetmaster language: language-cx1 wikibase-registry: libcanada-01 catgraph: logintest2 matrix: matrix-synapse-01 test-twemproxy: mc-clusterA-2 mcr-dev: mcr-base mcr-dev: mcr-sdc wikibase-registry: misc-01 ores: ores-lb-03 ores-staging: ores-misc-01 ores: ores-redis-02 ores-staging: ores-staging-01 ores: ores-worker-01 ores: ores-worker-02 phlogiston: phlogiston-4 puppet: puppet-ema-2 puppet: puppet-jmm-kernel-jessie puppet: puppet-jmm-kernel-stretch2 thumbor: puppetmaster quarry: quarry-worker-01 k8splay: qube-node1 k8splay: qube-node2 recommendation-api: recommendation-api-build search: rel2 sentry: sentry-builder suggestbot: suggestbot-01 toolsbeta: toolsbeta-sgewebgrid-generic-0901 reading-web-staging: trending library-upgrader: upgrader-04 visualeditor: visualeditor-test2 wikidata-dev: wikibase-stretch wikibrain: wikibrain-embeddings-01 wikibrain: wikibrain-embeddings-02 globaleducation: wikiedubackups wikilabels: wikilabels-backups wikispeech: wikispeech-tts-dev wikispeech: wikispeech-wiki-stretch wikistats: wikistats-greyhound wikidiff2-wmde-dev: wmde-wikidiff2-debug wpx: wpx-mediawiki-02 analytics: zk1-2
On 7/31/19 7:55 AM, Andrew Bogott wrote:
As part of routine networking and OS upgrades, I'll be emptying two more hypervisors (cloudvirt1021 and cloudvirt1022) on Monday and Tuesday next week, the 5th and 6th. This will result in downtime for many VMs as they are copied and restarted. A complete list of affected instances follows.
Please let me know if you need to schedule a more specific window for your downtime. Better yet, if any of the listed VMs are defunct and can simply be deleted, please do that now and save me some time!
-Andrew + the WMCS team
Affected instances (shown as <project>: <instance name>):
account-creation-assistance: accounts-db3 analytics: deployment-server analytics: zk1-1 analytics: zk1-3 antiharassment: antiharassment-web1 automation-framework: af-debmonitor automation-framework: af-puppetmaster02 bastion: bastion-eqiad1-01 bastion: bastion-restricted-eqiad1-01 catgraph: sylvester cloudinfra: mx-out01 cloudinfra: mx-out02 cyberbot: cyberbot-exec-01 design: wikimedia-ui discourse: discourse1002 download: download-01 dumps: dumps-1 dumps: dumps-2 dwl: taxonbot etcd: etcd04 etcd: etcd05 etcd: etcd06 extdist: extdist-01 fastcci: fastcci-worker1 fastcci: fastcci-worker2 git: gerrit-mysql git: gerrit-test git: puppet-paladox google-api-proxy: google-api-proxy-02 grantreview: grantreview-03 hashtags: hashtags-prod hat-imagescalers: k8s-test-builder hhvm: hhvm-jmm-vp9 hhvm: hhvm-stretch-jmm huggle: huggle-wl huggle: xmlrcs iiab: medbox3-iiab integration: integration-slave-docker-1043 k8splay: qube-master language: language-apertium2 language: language-cx language: language-eg language: language-mleb-master language: language-mleb-stable language: moses01-small logging: filippo-log-jessie01 logging: filippo-log-stretch01 mcr-dev: mcr-full mediawiki-vagrant: mwv-builder-02 mediawiki-vagrant: mwv-stretch-migration mediawiki-vagrant: T183456-jessie mediawiki-vagrant: T183456-stretch mix-n-match: mixnmatch mobile: apps-team-tools mobile: emoji mwoffliner: mwoffliner2 mwoffliner: mwoffliner4 mwstake: mwstake mwv-apt: mwv-apt-01 newsletter: newsletter-test openstack: labs-bootstrapvz-jessie openstack: vmbuilder-trusty ores: ores-web-01 ores: ores-web-03 orig: gnd-01 packaging: builder01 packaging: calico-builder01 petscan: petscan3 phabricator: phabricator phabricator: phab-tin phabricator: puppet-phabricator pluggableauth: pluggableauth-server puppet: puppet-jmm-pmaster puppet: puppet-jmm-pmaster-client qna: meza-new4 quarry: quarry-db-01 quarry: quarry-web-01 quarry: quarry-worker-02 reading-web-staging: experiments reading-web-staging: marvin-staging reading-web-staging: readingwebstaging recommendation-api: gapfinder-tools recommendation-api: tool-alpha search: cirrus-browser-bot search: relforge-search search: wdsearch2 snuggle: snuggle-wikidatawiki-01 social-tools: timeless2 striker: striker-uwsgi03 test-twemproxy: mc-clusterB-1 test-twemproxy: mc-clusterB-2 toolsbeta: toolsbeta-sgebastion-04 toolsbeta: toolsbeta-sgeexec-0901 toolsbeta: toolsbeta-sgegrid-master toolserver-legacy: relic-stretch traffic: diffscan traffic: traffic-puppetmaster traffic: traffic-text-stretch utrs: utrs-beta-production utrs: utrs-database2 utrs: utrs-production2 wcdo: wcdo wikibase-registry: orig-01 wikibase-registry: wbregistry-01 wikidata-dev: federated-wikis wikidata-dev: federated-wikis2 wikidata-primary-sources-tool: pst wikidiff2-wmde-dev: sqltest02 wikidiff2-wmde-dev: wmde-wikidiff2-patched wikidiff2-wmde-dev: wmde-wikidiff2-unpatched wikilabels: wikilabels-staging-01 wikimania-support: scholarships-02 wikispeech: wikispeech-tts-release wikitextexp: parsing-qa-01 wildcat: dannyb xtools: xtools-dev04 xtools: xtools-prod03 xtools: xtools-prod05