On Oct 20, 2014 1:36 PM, "Oliver Keyes" <okeyes@wikimedia.org> wrote:
> I guess mostly I'm just confused as to what you'd add on top of "SSH keys, automated logging and transparent documentation".

I *think* Pine was asking for automatic query logging similar to what you've just said is already happening.

Eventually maybe we'll get these types of queries mostly running on hadoop+M/R. (vs. processing a local file on disk) We could publish public logs of M/R jobs and for some of them allow public download of the output. (but this particular query would not allow public downloading of the output because IP/UA string/etc.)

-Jeremy