Analytics did Limn, Kraken, and Report Card work in August, described in https://blog.wikimedia.org/2012/09/04/engineering-august-2012-report/ . For context, you might also like to review their roadmap, goals, and metrics definitions:
* https://www.mediawiki.org/wiki/Analytics/2012-2013_Roadmap * https://www.mediawiki.org/wiki/Wikimedia_Engineering/2012-13_Goals#Analytics * https://www.mediawiki.org/wiki/Analytics/Metric_definitions
In August and early September, Andrew Otto and Dave Schoonover concluded their research into distributed logging systems to replace udp2log for Kraken,: check out https://www.mediawiki.org/wiki/Analytics/Kraken/Logging_Solutions_Overview .
"The options discussed here will be used as the main data firehose into the Analytics Kraken Cluster. This is an overview meant to summarize the research that the Analytics team has done, and will be used to start a discussion with ops."
Thanks Sumana,
See this one also for more in depth about Kafka: http://www.mediawiki.org/wiki/Analytics/Kraken/Logging_Solutions_Recommendat...
-Ao
On Sep 6, 2012, at 3:01 PM, Sumana Harihareswara sumanah@wikimedia.org wrote:
Analytics did Limn, Kraken, and Report Card work in August, described in https://blog.wikimedia.org/2012/09/04/engineering-august-2012-report/ . For context, you might also like to review their roadmap, goals, and metrics definitions:
https://www.mediawiki.org/wiki/Wikimedia_Engineering/2012-13_Goals#Analytics
In August and early September, Andrew Otto and Dave Schoonover concluded their research into distributed logging systems to replace udp2log for Kraken,: check out https://www.mediawiki.org/wiki/Analytics/Kraken/Logging_Solutions_Overview .
"The options discussed here will be used as the main data firehose into the Analytics Kraken Cluster. This is an overview meant to summarize the research that the Analytics team has done, and will be used to start a discussion with ops."
-- Sumana Harihareswara Engineering Community Manager Wikimedia Foundation
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics