Captured in Phab:

https://phabricator.wikimedia.org/T78355

Please wordsmith and add other projects as appropriate.  Thanks!

On Thu, Dec 11, 2014 at 4:28 PM, Ori Livneh <ori@wikimedia.org> wrote:


On Thu, Dec 11, 2014 at 4:11 PM, Dario Taraborelli <dtaraborelli@wikimedia.org> wrote:
is there a way to inspect invalid events in near real time without having access to vanadium?


The key is 'diffSeries(eventlogging.overall.raw.rate,eventlogging.overall.valid.rate)', which gets you the rate of invalid events per second.

It is not broken down by schema, though.

We can't write invalid events to a database -- at least not the same way we write well-formed events. The table schema is derived from the event schema, so an invalid event would violate the constraints of the table as well.

It's possible (and easy) to set something up that watches invalid events in real-time and does something with them. The question is: what? E-mail an alert? Produce a daily report? Generate a graph?

If you describe how you'd like to consume the data, I can try to hash out an an implementation with Nuria and Christian.

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics