[Labs-l] [tool labs] central logging service

[Petr Bena]

Using this service is as easy as typing

pyhon bot.py | /shared/logeater mybot

given that a bot is sending out log to stdout it will be stored at
http://tools.wmflabs.org/logs/data/mybot


The service of course support many other ways to store logs, but this
is a simplest example I can think of :)

On Sat, Jun 8, 2013 at 10:44 AM, Petr Bena <benapetr at gmail.com> wrote:
> Hi,
>
> per https://bugzilla.wikimedia.org/show_bug.cgi?id=48846 we are
> setting up a logging service for tools and bots, so that every tool or
> bot can easily log to a central logging base which in future should
> support some nice web-based gui with log filtering (eventually some
> 3rd notifications, like e-mails (sms) / irc pings) and so on.
>
> The website of this project is here: http://tools.wmflabs.org/logs/
>
> I haven't got much feedback so far so I would appreciate some, in this
> moment we are in phase where we are discussing the best options how to
> design this feature.
>
> Some people believe that it would be best to use some already existing
> logging service such as facebook's scribe, I /think/ that despite the
> already made and working solution might be a good idea, on other hand
> these usually were designed for another purpose than what we need and
> thus it's quite complicated to set them up for our needs. Having said
> that I started working on simple, but powerful logging daemon which
> should do precisely what we need (and which can be infinitely extended
> for our purposes) - but of course we can set up multiple solutions and
> let tool operators pick what they prefer most.
>
> If it's simpler for a tool / bot operator to intergrate with syslog,
> then why we shouldn't have it as well? But I must admit I found it
> quite complicated to make rsyslog behave as we need (I believe it's
> not even possible for it to match all out potential needs)