[Labs-l] Spring Cleaning

[Alex Monk]

Yeah, a lot of these numbers do not match the actual amount used shown by
df.

On 5 March 2016 at 19:18, Mr. Maximilian Doerr <maximilian.doerr at gmail.com>
wrote:

> 38G  523df61c-07f0-41ba-924d-e2b8e474b4d7  tools-exec-cyberbot  tools marc
>
> What on Earth could Cyberbot be generating?  Nothing in its folder amounts
> to that size!!!!
>
> Any info you can provide on this, Andrew?
>
> Cyberpower678
> English Wikipedia Account Creation Team
> ACC Mailing List Moderator
> Global User Renamer
>
> On Mar 4, 2016, at 18:03, Andrew Bogott <abogott at wikimedia.org> wrote:
>
> On 3/4/16 4:35 PM, Magnus Manske wrote:
>
> Huh. WDQ seems to be the biggest problem, but I can't find the data - only
> ~20GB in total.
>
> I'm not 100% sure about how our qcow2 setup works, but I suspect that if
> the storage use of an instance grows and then subsequently shrinks the new
> space is not automatically reclaimed.  So if you see specific instances
> that are huge on my report but small in reality, I can reclaim empty space
> by shutting the instances down briefly and recompressing.
>
> Magnus (and, really, anyone) if you find cases like that please let me
> know the instance and project and if/when you could tolerate downtime for a
> few minutes.
>
> Thanks!
>
> -Andrew
>
>
>
> Unless Yuvi has cleaned up in the meantime, or I don't have permissions...
>
> On Fri, Mar 4, 2016 at 7:45 PM Brion Vibber < <bvibber at wikimedia.org>
> bvibber at wikimedia.org> wrote:
>
>> Thanks for the reminder ping! I still need ogvjs-testing for ongoing work
>> on the mobile side (the desktop integration is done months ago) but I can
>> probably trim its disk space on my end. (It uses a lot of space because
>> it's got local copies of some videos from Commons, but the player can pull
>> them directly from Commons these days.)
>>
>> -- brion
>>
>> On Fri, Mar 4, 2016 at 10:59 AM, Andrew Bogott < <abogott at wikimedia.org>
>> abogott at wikimedia.org> wrote:
>>
>>>     Disk space is always the most limited factor on the Labs
>>> virtualization servers.  If you're using it for something good, then no one
>>> minds!  If you're using it for logfiles that no one ever reads, or using it
>>> for instances that have long-since been forgotten and no one cares about,
>>> then I mind a little bit :)
>>>
>>>     Attached is an epic list:  Every instance, sorted by disk
>>> footprint.  Please take a moment to hit ctrl-F and scan the list of
>>> instances that you created or that are part of a project you work with.
>>> Look at those instances, and ask yourself if they would be missed.
>>>
>>>     If the answer is 'no,' please delete them!  Or, email me and I'll
>>> delete them.  (Actually, even if you delete them yourself, I'd appreciate
>>> knowing about it so I know whether or not emails like this are useful.)  If
>>> the answer is 'maybe' then please call my attention to the instances in
>>> question, and I'll do the necessary pestering and verifying to determine
>>> whether or not they can be safely deleted.
>>>
>>>     Benefits of good VM hygiene include:  Less rebalancing-related
>>> downtime, better VM performance, happier operators,  and more money for the
>>> Labs team to spend on things more interesting than storage space.
>>>
>>> Thanks for your attention!
>>>
>>>
>>> -Andrew
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Labs-l mailing list
>>> Labs-l at lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/labs-l
>>>
>>>
>> _______________________________________________
>> Labs-l mailing list
>> Labs-l at lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/labs-l
>>
>
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>
>
>
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.wikimedia.org/pipermail/labs-l/attachments/20160305/687c4711/attachment-0001.html>