<div dir="ltr">Yeah this will take beta down for a bit again. When deployment-db0[34] start again, someone needs to log in and run `service mysql start`. And when deployment-(tin|mira) start again, `keyholder arm`.</div><div class="gmail_extra"><br><div class="gmail_quote">On 2 November 2016 at 17:03, Greg Grossmeier <span dir="ltr"><<a href="mailto:greg@wikimedia.org" target="_blank">greg@wikimedia.org</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">This is on-going and will affect Beta Cluster stability. FYI.<br>
<br>
----- Forwarded message from Andrew Bogott <<a href="mailto:abogott@wikimedia.org">abogott@wikimedia.org</a>> -----<br>
<br>
> Date: Wed, 2 Nov 2016 10:42:31 -0500<br>
> From: Andrew Bogott <<a href="mailto:abogott@wikimedia.org">abogott@wikimedia.org</a>><br>
> To: "A list for announcements and discussion related to the Wikimedia Labs project." <<a href="mailto:labs-l@lists.wikimedia.org">labs-l@lists.wikimedia.org</a>><br>
> Subject: [Labs-l] More reboots today, 18:00 UTC :(<br>
> Reply-To: <a href="mailto:andrewbogott@gmail.com">andrewbogott@gmail.com</a>, Wikimedia Labs <<a href="mailto:labs-l@lists.wikimedia.org">labs-l@lists.wikimedia.org</a>><br>
><br>
> Good news: I've completed patching all the individual VMs listed in<br>
> previous emails.<br>
><br>
> Bad news: We need to reboot a couple of the physical hosts yet again. A<br>
> complete list of instances that will be affected follows below.<br>
><br>
> The reboots will start at 18:00 UTC, in about two and a half hours.<br>
><br>
> As usual, Tools users can mostly ignore this, but should expect the<br>
> occasional hiccup.<br>
><br>
> Affected instances:<br>
><br>
><br>
> accounts-db3 | account-creation-assistance | ACTIVE | -<br>
> | Running | public=10.68.20.23 |<br>
> af-master02 | automation-framework | ACTIVE | -<br>
> | Running | public=10.68.22.243 |<br>
> af-puppetmaster01 | automation-framework | ACTIVE | -<br>
> | Running | public=10.68.19.175 |<br>
> boo | discovery-stats | ACTIVE | - |<br>
> Running | public=10.68.21.207 |<br>
> captcha-static-01 | privpol-captcha | ACTIVE | - |<br>
> Running | public=10.68.20.188 |<br>
> ci-jessie-wikimedia-408952 | contintcloud | ACTIVE | -<br>
> | Running | public=10.68.16.180 |<br>
> ci-trusty-wikimedia-408958 | contintcloud | ACTIVE | -<br>
> | Running | public=10.68.17.103 |<br>
> danny | gitblit | ACTIVE | -<br>
> | Running | public=10.68.16.58 |<br>
> deployment-apertium02 | deployment-prep | ACTIVE | - |<br>
> Running | public=10.68.22.254 |<br>
> deployment-db03 | deployment-prep | ACTIVE | -<br>
> | Running | public=10.68.23.30 |<br>
> deployment-db04 | deployment-prep | ACTIVE | - |<br>
> Running | public=10.68.18.35 |<br>
> deployment-jobrunner02 | deployment-prep | ACTIVE | - |<br>
> Running | public=10.68.19.42 |<br>
> deployment-kafka05 | deployment-prep | ACTIVE | - |<br>
> Running | public=10.68.21.106 |<br>
> deployment-mediawiki05 | deployment-prep | ACTIVE | -<br>
> | Running | public=10.68.22.21 |<br>
> deployment-mediawiki06 | deployment-prep | ACTIVE | - |<br>
> Running | public=10.68.19.241 |<br>
> deployment-pdfrender | deployment-prep | ACTIVE | -<br>
> | Running | public=10.68.17.167 |<br>
> deployment-phab02 | deployment-prep | ACTIVE | - |<br>
> Running | public=10.68.19.232 |<br>
> deployment-prometheus01 | deployment-prep | ACTIVE | -<br>
> | Running | public=10.68.20.247 |<br>
> deployment-tin | deployment-prep | ACTIVE | -<br>
> | Running | public=10.68.21.205 |<br>
> dewiktionary | cognate | ACTIVE | -<br>
> | Running | public=10.68.20.214 |<br>
> discovery-prototypes | shiny-r | ACTIVE | - |<br>
> Running | public=10.68.16.238 |<br>
> drmf2017 | math | ACTIVE | -<br>
> | Running | public=10.68.19.68 |<br>
> encoding02 | video | ACTIVE | -<br>
> | Running | public=10.68.21.74 |<br>
> encoding03 | video | ACTIVE | - |<br>
> Running | public=10.68.20.55 |<br>
> etcd06 | etcd | ACTIVE | - |<br>
> Running | public=10.68.18.90 |<br>
> fawp | fa-wp | ACTIVE | - |<br>
> Running | public=10.68.17.108 |<br>
> fawp-tts | fa-wp | ACTIVE | -<br>
> | Running | public=10.68.19.133 |<br>
> frwiktionary | cognate | ACTIVE | -<br>
> | Running | public=10.68.20.14 |<br>
> gerrit-mysql | git | ACTIVE | - |<br>
> Running | public=10.68.23.211 |<br>
> gerrit-test3 | git | ACTIVE | -<br>
> | Running | public=10.68.23.148, 208.80.155.149 |<br>
> integration-puppetmaster01 | integration | ACTIVE | - |<br>
> Running | public=10.68.22.41 |<br>
> integration-slave-jessie-1003 | integration | ACTIVE | - |<br>
> Running | public=10.68.21.145 |<br>
> integration-slave-jessie-<wbr>android | integration | ACTIVE | - |<br>
> Running | public=10.68.19.239 |<br>
> jenkins-slave-01 | git | ACTIVE | - |<br>
> Running | public=10.68.22.0 |<br>
> kafka501 | analytics | ACTIVE | -<br>
> | Running | public=10.68.20.29 |<br>
> kafka601 | analytics | ACTIVE | - |<br>
> Running | public=10.68.21.56 |<br>
> labs-traefikbuild | openstack | ACTIVE | -<br>
> | Running | public=10.68.19.222 |<br>
> language-mleb-legacy | language | ACTIVE | -<br>
> | Running | public=10.68.22.180 |<br>
> maps-graphoid | maps-team | ACTIVE | -<br>
> | Running | public=10.68.23.213 |<br>
> mwdiffstuff | catgraph | ACTIVE | -<br>
> | Running | public=10.68.22.76 |<br>
> netdata-1 | netdata | ACTIVE | - |<br>
> Running | public=10.68.21.211 |<br>
> ores-redis-02 | ores | ACTIVE | - |<br>
> Running | public=10.68.19.39 |<br>
> phlogiston-3 | phlogiston | ACTIVE | - |<br>
> Running | public=10.68.21.110 |<br>
> pole | wikidata-query | ACTIVE | - |<br>
> Running | public=10.68.19.199 |<br>
> popcorn | ogvjs-integration | ACTIVE | -<br>
> | Running | public=10.68.21.94 |<br>
> prugna | wmwcourse | ACTIVE | - |<br>
> Running | public=10.68.23.201 |<br>
> puppet-ema | puppet | ACTIVE | -<br>
> | Running | public=10.68.19.244 |<br>
> puppet-jmm-test-jessie2 | puppet | ACTIVE | -<br>
> | Running | public=10.68.23.19 |<br>
> puppet-jmm-yubitest | puppet | ACTIVE | -<br>
> | Running | public=10.68.21.15 |<br>
> puppet-test | recommendation-api | ACTIVE | -<br>
> | Running | public=10.68.23.125 |<br>
> relforge-search | search | ACTIVE | - |<br>
> Running | public=10.68.18.222 |<br>
> repository | integration | ACTIVE | -<br>
> | Running | public=10.68.18.179 |<br>
> security-test | recommendation-api | ACTIVE | -<br>
> | Running | public=10.68.16.156 |<br>
> snuggle-enwiki-01 | snuggle | ACTIVE | -<br>
> | Running | public=10.68.20.90 |<br>
> sonarqube | search | ACTIVE | -<br>
> | Running | public=10.68.23.227 |<br>
> striker-deploy03 | striker | ACTIVE | - |<br>
> Running | public=10.68.23.63 |<br>
> striker-uwsgi02 | striker | ACTIVE | - |<br>
> Running | public=10.68.18.120 |<br>
> swproxy | services | ACTIVE | -<br>
> | Running | public=10.68.16.62 |<br>
> taxonbot | dwl | ACTIVE | -<br>
> | Running | public=10.68.16.118 |<br>
> test | gitblit | ACTIVE | - |<br>
> Running | public=10.68.16.93 |<br>
> thcipriani-mediawiki | staging | ACTIVE | - |<br>
> Running | public=10.68.22.89 |<br>
> thcipriani-proxy | staging | ACTIVE | - |<br>
> Running | public=10.68.19.187 |<br>
> trusty-update | puppet | ACTIVE | - |<br>
> Running | public=10.68.16.32 |<br>
> tupu | wikidocumentaries | ACTIVE | -<br>
> | Running | public=10.68.20.12 |<br>
> util-abogott | testlabs | ACTIVE | -<br>
> | Running | public=10.68.21.108 |<br>
> utrs-secondary | utrs | ACTIVE | - |<br>
> Running | public=10.68.22.174 |<br>
> vem2 | maps-team | ACTIVE | -<br>
> | Running | public=10.68.19.166 |<br>
> wpx-projbase-01 | wpx | ACTIVE | -<br>
> | Running | public=10.68.21.142 |<br>
> xenon | rcm | ACTIVE | - |<br>
> Running | public=10.68.21.58 |<br>
><br>
><br>
> ______________________________<wbr>_________________<br>
> Labs-l mailing list<br>
> <a href="mailto:Labs-l@lists.wikimedia.org">Labs-l@lists.wikimedia.org</a><br>
> <a href="https://lists.wikimedia.org/mailman/listinfo/labs-l" rel="noreferrer" target="_blank">https://lists.wikimedia.org/<wbr>mailman/listinfo/labs-l</a><br>
<br>
----- End forwarded message -----<br>
<span class="HOEnZb"><font color="#888888"><br>
--<br>
| Greg Grossmeier GPG: B2FA 27B1 F7EB D327 6B8E |<br>
| Release Team Manager A18D 1138 8E47 FAC8 1C7D |<br>
<br>
______________________________<wbr>_________________<br>
QA mailing list<br>
<a href="mailto:QA@lists.wikimedia.org">QA@lists.wikimedia.org</a><br>
<a href="https://lists.wikimedia.org/mailman/listinfo/qa" rel="noreferrer" target="_blank">https://lists.wikimedia.org/<wbr>mailman/listinfo/qa</a><br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Alex Monk</div><div>VisualEditor/Editing team</div><div><a href="https://wikimediafoundation.org/wiki/User:Krenair_(WMF)" target="_blank">https://wikimediafoundation.org/wiki/User:Krenair_(WMF)</a></div></div></div>
</div>