Thanks Dan!

On Tue, Nov 19, 2013 at 4:26 PM, Dan Andreescu <dandreescu@wikimedia.org> wrote:

K, so a quick follow-up on this.  Jon and I worked today and identified two short term problems.

1. http://mobile-reportcard.wmflabs.org/graphs/edits-monthly-5plus-editors no longer updates because the query used for it takes too long to finish

2. the scripts run hourly even for graphs that only need to be updated daily

For 1, I fiddled with the SQL until it performed a little better.  It was also not correct, as I believe it was getting "the number of people who created an account in month X and made >= 5 edits anytime".  I changed it to what I assumed we wanted, which is "the number of people who created an account and made >= 5 edits in month X".  This new query (https://gist.github.com/milimetric/7554108) takes 4 minutes to run 3 months' worth.  Juliusz, any idea what the timeout is on that job?  I'm running the query now for 13 months and if it's < timeout, we can just deploy it.  Otherwise, we can maybe run one month at a time and concat results.  Let me know what you think and I'll make a Change

This is actually not correct - the query is supposed to be who created an account in month X and made >= 5 edits ever. But, if we can't make that kind of query performant enough... are you ok with this change, Kenan?

--
Arthur Richards

Software Engineer, Mobile

[[User:Awjrichards]]

IRC: awjr

+1-415-839-6885 x6687

_______________________________________________
Analytics mailing list
Analytics@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/analytics