Incident documentation updated: https://wikitech.wikimedia.org/wiki/Incident_documentation/20150107-EventLogging

On Wed, Jan 7, 2015 at 10:58 AM, Nuria Ruiz <nuria@wikimedia.org> wrote:
Team:

Issues on event logging have been solved, outage of client side events (did not affected server side events) lasted about 12 hours. 

Please see: http://picpaste.com/Screen_Shot_2015-01-07_at_10.50.28_AM-NsMSPgHp.png


Thanks, 

Nuria

On Wed, Jan 7, 2015 at 3:57 AM, Christian Aistleitner <christian@quelltextlich.at> wrote:
[ Adding eventlogging-alerts to CC ]

On Wed, Jan 07, 2015 at 12:15:09PM +0100, quelltextlich e.U. - Christian Aistleitner wrote:
> Hi,
>
> just a quick heads up that since 2015-01-07 ~1:55 only <30% of the
> EventLogging events are getting written to the database.
>
> It seems a deployment went wrong and validation is no longer working
> as expected. Somewhere >70% of the messages no longer validate and
> hence do not get written to the database.
>
> The raw log files (pre-validation) are still getting written, so data
> is not lost, and backfilling is possible.
>
>
> Best regards,
> Christian
>
>
> --
> ---- quelltextlich e.U. ---- \\ ---- Christian Aistleitner ----
>                            Companies' registry: 360296y in Linz
> Christian Aistleitner
> Kefermarkterstrasze 6a/3     Email:  christian@quelltextlich.at
> 4293 Gutau, Austria          Phone:          +43 7946 / 20 5 81
>                              Fax:            +43 7946 / 20 5 81
>                              Homepage: http://quelltextlich.at/
> ---------------------------------------------------------------

--
---- quelltextlich e.U. ---- \\ ---- Christian Aistleitner ----
                           Companies' registry: 360296y in Linz
Christian Aistleitner
Kefermarkterstrasze 6a/3     Email:  christian@quelltextlich.at
4293 Gutau, Austria          Phone:          +43 7946 / 20 5 81
                             Fax:            +43 7946 / 20 5 81
                             Homepage: http://quelltextlich.at/
---------------------------------------------------------------

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics