[Labs-announce] New instance creation temporarily disabled

[Andrew Bogott]

The Labs team has spent a lot of time discussing how to avoid future 
capacity crunches.  This will be a long term consideration involving 
coordination with project admins.

Outline of our progress:

- Self-service instance creation is again enabled for Labs in Horizon 
(https://horizon.wikimedia.org) <https://horizon.wikimedia.org%29>

- We've reduced the permitted overcommit ratios for RAM and disk space 
(T140119 and T140122)

- We've reduced default quotas which affects new and some existing 
projects. We believe this will have two advantages:  1) When growth 
happens we'll know about it, and 2) There will be an opportunity to 
consult about what growth is necessary and how best to take advantage of 
capacity.

- We are transitioning to a process for quota increase requests using 
Phabricator (see T140904)

-  Even with our new nodes we are still tight on space without diligent 
clean up. https://wikitech.wikimedia.org/wiki/Purge_2016

Let me know if you have any questions or concerns!

-Andrew & the Labs team


On 7/5/16 5:05 PM, Andrew Bogott wrote:
> We're running into serious capacity issues this week, so I have 
> temporarily disabled the creation of new labs instances.  We have new 
> hardware sitting in the datacenter already, so at worst we'll be back 
> to normal sometime next week.
>
> Sorry for the inconvenience.  And, as usual, if you have instances you 
> aren't using, please delete them!
>
> -Andrew
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-announce/attachments/20160720/735cfe18/attachment.html>