Hi,
On Mon, Mar 03, 2014 at 09:19:03PM -0500, Andrew Otto wrote:
Who generates the mobile and zero limn dashboards?
For the Wikipedia Zero limn dashboards that would be me.
I am currently generating log files from Kafka that should be useable in place of the ones that udp2log generates. It’d be cool to compare the output of the two.
Totally! Hoping Toby puts it on the agenda for the upcoming Sprint.
Have fun, Christian
P.S.: I looked at the files yesterday, and kafka seems to still eat the first character of the Headers in some settings. For example when looking for User Agents starting in “okia” (“Nokia” without leading “N”), the kafkatee file has >10K matches for the 20140303 file [1], while the udp2log file has 0 [2].
[1] ___________________________________________________________ qchris@stat1002 // 0 // 09:58:21 cwd: ~ zcat /a/log/webrequest/zero/zero.tsv.log-20140303.gz | cut -f 14 | grep -c '^okia' 11552
[2] ___________________________________________________________ qchris@stat1002 // 0 // 09:58:32 cwd: ~ zcat /a/squid/archive/zero/zero.tsv.log-20140303.gz | cut -f 14 | grep -c '^okia' 0