[Labs-l] [Labs-announce] Some Labs instances rebooting TODAY, 19:00 UTC

[Andrew Bogott]

Hello!

      We have discovered a surprisingly terrible bug in the kernel 
that's running on two of the nova-compute hosts.  To remedy this, we 
will be downgrading and rebooting both hosts in a few hours, at high 
noon San Francisco time, 19:00UTC.

      We will shuffle things around to so there is no impact on Tools. 
VMs on these hosts only (listed below) will experience a single reboot 
and accompanied downtime.

      Sorry for the short notice... it's worth it, believe me. We'll 
work on getting a post-mortem incident report written, but that may not 
happen until Monday.  In the meantime, here is a complete list of 
instances that will be affected:


| 330f16d6-374d-44a8-bf96-53e763d5dd3a | captcha-apiproxy-02            
| privpol-captcha
| 00422b7c-9711-4a92-bba4-73db0efb5889 | deployment-db01                
| deployment-prep
| 1597e37a-99e6-431e-8117-3901e4ac9858 | encoding02                     
| video
| 01518800-406c-4689-a289-9e3e33fd387b | kafka501                       
| analytics
| 6a5289e9-1b69-48a3-a6fd-5de63c2ee285 | labstore-test-05               
| testlabs
| 37fc9d21-6614-4442-9b45-a7ae349b6d09 | secgroup-server-labvirt1012    
| testlabs
| d35fedde-9f0f-42b2-a22d-780cb1477a17 | spice-test-102                 
| admin
| 21706518-ccd4-45b1-9853-37f463d02393 | striker-uwsgi01                
| striker
| c4bc63f8-cbd7-4384-b349-54b115e91a5c | util-abogott                   
| testlabs
| 3d3288cd-3523-449c-bf48-1bd48cac3e5d | 
captcha-proxypostgres-01         | privpol-captcha
| 7ebb2447-7c74-4fd1-aa5e-19c48011e39d | 
deployment-depurate01            | deployment-prep
| 9336405f-cf57-4234-9c73-0a539d97580e | 
deployment-kafka05               | deployment-prep
| 60ece1f0-327b-49b2-aa1e-a3df241f70fb | 
encoding03                       | video
| 8b90e688-aba7-4b6c-9b6b-bbb13ec84da5 | 
gerrit-test3                     | git
| 833bb2a0-a442-445e-8210-ac77e950ead7 | 
integration-slave-jessie-1003    | integration
| a64e731e-c987-4b84-85b9-cf450275d26d | 
integration-slave-jessie-android | integration
| a18beafb-2279-49fa-8b88-049b3f55a2f5 | 
kafka601                         | analytics
| fe12b525-5a64-48ff-a3a3-e69c65043e26 | 
labstore-test-01                 | testlabs
| 9b45a5c1-c6a5-4a59-8305-9d4542a4c27a | 
labstore-test-02                 | testlabs
| f5bcb8c1-51b2-4820-bda3-a7a3155b0a6f | 
mwdiffstuff                      | catgraph
| 59664505-be72-4294-b639-b1ea2218a44b | 
ores-redis-02                    | ores
| d5b434ce-2cae-4a56-9b95-4459913516e9 | 
pole                             | wikidata-query
| fdc47372-b60c-4c61-ab27-9231a5fd2d4e | 
secgroup-server-labvirt1013      | testlabs
| c8e73c70-9d13-480f-a6a9-01c46328a83d | 
striker-build                    | striker
| 55e6d403-c916-44f9-881f-23dec8968111 | 
striker-deploy03                 | striker
| d54ea2da-f3d5-4d8b-aa47-41837accb285 | 
utrs-secondary                   | utrs


-Andrew


_______________________________________________
Labs-announce mailing list
Labs-announce at lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/labs-announce