[Labs-l] Spring Cleaning

Andrew Bogott abogott at wikimedia.org
Fri Mar 4 23:03:30 UTC 2016


On 3/4/16 4:35 PM, Magnus Manske wrote:
> Huh. WDQ seems to be the biggest problem, but I can't find the data - 
> only ~20GB in total.
I'm not 100% sure about how our qcow2 setup works, but I suspect that if 
the storage use of an instance grows and then subsequently shrinks the 
new space is not automatically reclaimed.  So if you see specific 
instances that are huge on my report but small in reality, I can reclaim 
empty space by shutting the instances down briefly and recompressing.

Magnus (and, really, anyone) if you find cases like that please let me 
know the instance and project and if/when you could tolerate downtime 
for a few minutes.

Thanks!

-Andrew



> Unless Yuvi has cleaned up in the meantime, or I don't have permissions...
>
> On Fri, Mar 4, 2016 at 7:45 PM Brion Vibber <bvibber at wikimedia.org 
> <mailto:bvibber at wikimedia.org>> wrote:
>
>     Thanks for the reminder ping! I still need ogvjs-testing for
>     ongoing work on the mobile side (the desktop integration is done
>     months ago) but I can probably trim its disk space on my end. (It
>     uses a lot of space because it's got local copies of some videos
>     from Commons, but the player can pull them directly from Commons
>     these days.)
>
>     -- brion
>
>     On Fri, Mar 4, 2016 at 10:59 AM, Andrew Bogott
>     <abogott at wikimedia.org <mailto:abogott at wikimedia.org>> wrote:
>
>         Disk space is always the most limited factor on the Labs
>         virtualization servers.  If you're using it for something
>         good, then no one minds!  If you're using it for logfiles that
>         no one ever reads, or using it for instances that have
>         long-since been forgotten and no one cares about, then I mind
>         a little bit :)
>
>             Attached is an epic list:  Every instance, sorted by disk
>         footprint.  Please take a moment to hit ctrl-F and scan the
>         list of instances that you created or that are part of a
>         project you work with.  Look at those instances, and ask
>         yourself if they would be missed.
>
>             If the answer is 'no,' please delete them!  Or, email me
>         and I'll delete them.  (Actually, even if you delete them
>         yourself, I'd appreciate knowing about it so I know whether or
>         not emails like this are useful.)  If the answer is 'maybe'
>         then please call my attention to the instances in question,
>         and I'll do the necessary pestering and verifying to determine
>         whether or not they can be safely deleted.
>
>             Benefits of good VM hygiene include:  Less
>         rebalancing-related downtime, better VM performance, happier
>         operators,  and more money for the Labs team to spend on
>         things more interesting than storage space.
>
>         Thanks for your attention!
>
>
>         -Andrew
>
>
>
>
>         _______________________________________________
>         Labs-l mailing list
>         Labs-l at lists.wikimedia.org <mailto:Labs-l at lists.wikimedia.org>
>         https://lists.wikimedia.org/mailman/listinfo/labs-l
>
>
>     _______________________________________________
>     Labs-l mailing list
>     Labs-l at lists.wikimedia.org <mailto:Labs-l at lists.wikimedia.org>
>     https://lists.wikimedia.org/mailman/listinfo/labs-l
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-l/attachments/20160304/64d2dac4/attachment-0001.html>


More information about the Labs-l mailing list