Hi all!
We just noticed a problem with the (old) version kafka-python client we are using to produce EventLogging events to Kafka: it doesn’t handle creation of new topics now that we’ve upgraded the Kafka cluster to 0.9.
This means that until we fix, events produced to new schemas will not be saved. We will fix this ASAP (hopefully by tomorrow), but in the meantime, don’t make new schemas! :) I will update again once we have this fixed.
Sorry for the trouble! -Andrew
Ah! I take it back! This morning I had time to look into this problem more. It wasn’t caused by the Kafka 0.9 upgrade. This is a configuration bug in beta labs that I caused[1] when I modified the Kafka puppetization for the upgrade tests there. The python clients EventLogging uses are able to auto create topics just fine. Phew!
This didn’t actually affect production, and is fixed in beta now too.
-Andrew
[1] Fix here: https://gerrit.wikimedia.org/r/#/c/288604/
On Thu, May 12, 2016 at 5:33 PM, Andrew Otto acotto@gmail.com wrote:
Hi all!
We just noticed a problem with the (old) version kafka-python client we are using to produce EventLogging events to Kafka: it doesn’t handle creation of new topics now that we’ve upgraded the Kafka cluster to 0.9.
This means that until we fix, events produced to new schemas will not be saved. We will fix this ASAP (hopefully by tomorrow), but in the meantime, don’t make new schemas! :) I will update again once we have this fixed.
Sorry for the trouble! -Andrew
Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics