On Mon, Jan 26, 2015 at 03:54:42PM -0800, Andrew Otto wrote:
Today qchris and I deployed some changes[1][2] to bring logs from misc_web varnishes into HDFS and Hive via Kafka. This isn’t a huge deal, but it does mean that we are now collecting webrequest logs for things like phabricator, annual.wikimedia.org http://annual.wikimedia.org/, graphite, stats.wikimedia.org http://stats.wikimedia.org/, etc.
What is this going to be used for? Are we just logging everything from misc? I personally hate to log things unless we absolutely need to.
Regards, Faidon