[Labs-l] Possible instance-creation issues in the next couple of hours (long since finished)

Andrew Bogott abogott at wikimedia.org
Thu Jun 18 14:24:56 UTC 2015


On 6/17/15 10:17 AM, Andrew Bogott wrote:
> We're about to roll out a few patches that change the instance 
> creation and deletion logic.  If all goes well no one will notice the 
> difference, but if there are unexpected bugs then instance creation 
> may fail in the meantime.
>
An update on this while NFS rebuilds:

Instance creation was restored last night, but I didn't want to declare 
victory until I ran some more tests this morning. Everything is working 
fine -- be warned, though, that our base images really expect NFS to be 
present, so in projects without NFS (which is most of them) it takes an 
extra 5-10 minutes for new instances to start up.  That clearly needs 
work, but in the meantime patience should pay off.

Also due to the NFS work, precise instances (which you really shouldn't 
be creating anyway) are especially slow to allow ssh access.  They 
should be accessible after about 40 minutes -- a reboot 10 or so minutes 
in should shorten that time considerably.

There's no immediate payoff for yesterday's image work[1], but this was 
an important step in moving towards a better-working Horizon.

[1] https://phabricator.wikimedia.org/T102047




More information about the Labs-l mailing list