[Labs-l] Resolved: Labs and toollabs outage in progress

John phoenixoverride at gmail.com
Wed Oct 8 12:33:25 UTC 2014


Yes, that is the same thing that prod does. UAs should always be sent

On Wed, Oct 8, 2014 at 7:18 AM, Philippe Elie <phil.el at free.fr> wrote:

> On Tue, 07 Oct 2014 at 18:32 -0500, Andrew Bogott wrote:
>
> > On 10/7/14 5:54 PM, Andrew Bogott wrote:
> > >One of the labs servers (virt1005) has just died.  Marc and I are
> > >investigating, but for the moment roughly 10% of labs instances are
> > >currently in a SHUTOFF state.  Please do not restart these instances
> until
> > >I send an 'all clear' message to the list.
> > Virt1005 is back up and seems to be OK.  I'm now booting all instances on
> > that box -- they should be up and running in a few minutes, but will show
> > signs of an unceremonious reboot so you'll want to make sure your
> services
> > are all still running properly.
> >
> > This crash may be related to overprovisioning on virt1005... we're in the
> > process of purchasing new hardware to expand capacity and avoid such
> issues
> > in the future.
> >
> > Thank you again for your patience!
>
> The internal proxy is up but its config changed, now it rejects request
> with an empty user agent, is this intended?
>
> --
> Phe
>
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-l/attachments/20141008/438b70c4/attachment.html>


More information about the Labs-l mailing list