[Labs-l] [tool labs] central logging service

[Ryan Lane]

On Sat, Jun 8, 2013 at 4:44 AM, Petr Bena <benapetr at gmail.com> wrote:

> Hi,
>
> per https://bugzilla.wikimedia.org/show_bug.cgi?id=48846 we are
> setting up a logging service for tools and bots, so that every tool or
> bot can easily log to a central logging base which in future should
> support some nice web-based gui with log filtering (eventually some
> 3rd notifications, like e-mails (sms) / irc pings) and so on.
>
> The website of this project is here: http://tools.wmflabs.org/logs/
>
> I haven't got much feedback so far so I would appreciate some, in this
> moment we are in phase where we are discussing the best options how to
> design this feature.
>
> Some people believe that it would be best to use some already existing
> logging service such as facebook's scribe, I /think/ that despite the
> already made and working solution might be a good idea, on other hand
> these usually were designed for another purpose than what we need and
> thus it's quite complicated to set them up for our needs. Having said
> that I started working on simple, but powerful logging daemon which
> should do precisely what we need (and which can be infinitely extended
> for our purposes) - but of course we can set up multiple solutions and
> let tool operators pick what they prefer most.
>
>
Why log logstash? You can use syslog, or other means of sending logs to it,
it has seach via elastic search. You can do log filtering at numerous
levels, and it has a few interfaces, kibana being the most popular.

It would really be nice to consider something that can be used as a
solution for all of labs, rather than just bots and tools.

- Ryan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.wikimedia.org/pipermail/labs-l/attachments/20130610/87ca90c0/attachment.html>