I've written up a little overview of the current and proposed Kraken architecture.

This is just an overview, so it does not try to explain how each of the individual pieces (Hadoop, Kafka, etc.) work.  Comments and questions please!

Okthxbye.

-Andrew O