[Labs-l] tools labs bot hammering Gerrit

[Brad Jorsch (Anomie)]

On Thu, Apr 3, 2014 at 3:47 AM, Antoine Musso <hashar+wmf at free.fr> wrote:

> An example node is tools-exec-03.eqiad.wmflabs
>
> Due to the nature of tools labs, it is a bit hard to figure out which
> bot was causing the issue.  The user agent was not meaningful.
>

If nothing else, you could give Coren a list of the hammer hits and ask him
to list for each the set of jobs running on the hitting node at the time of
the hit. Then the intersection of those sets would tell us which tools to
look at.


-- 
Brad Jorsch (Anomie)
Software Engineer
Wikimedia Foundation


On Thu, Apr 3, 2014 at 3:47 AM, Antoine Musso <hashar+wmf at free.fr> wrote:

> Hello,
>
> Yesterday evening (europe time), the tools exec nodes have been
> blacklisted from Gerrit.   Some user/bot was hammering the Gerrit server
> which slowed it down.
>
> An example node is tools-exec-03.eqiad.wmflabs
>
> Due to the nature of tools labs, it is a bit hard to figure out which
> bot was causing the issue.  The user agent was not meaningful.
>
>
> If anyone had a script/bot querying Gerrit please get in touch so we can
> help fix your script!
>
> Meanwhile all tools labs nodes are blocked on Gerrit via an iptables rule.
>
> You can contact hashar, _joe_ (both Europe based) or ^d (SF based) on
> IRC.  Or reply there.
>
> cheers,
>
> --
> Antoine "hashar" Musso
>
>
> _______________________________________________
> Labs-l mailing list
> Labs-l at lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/labs-l
>



-- 
Brad Jorsch (Anomie)
Software Engineer
Wikimedia Foundation
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20140403/23231ccb/attachment.html>