Hi all,
Ops is working on upgrading our web caching software from Varnish 3 to Varnish 4. At the moment, this would mean we would lost webrequest logs, since our webrequest logging software (varnishkafka) is incompatible with Varnish 4. There is an effort to fix this incompatibility, but Ops would like to be able to test Varnish 4 out in production in a limited fashion without having to worry about this blocker.
Question: Do any of you use the webrequest_source=‘misc’ partition for production analysis? If this Hive partition did not have data for a limited period of time, would this break anyone’s data?
If not, then Ops would like to use the misc cache cluster for testing this change.
Thanks! -Andrew & Luca